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Preface 



This book deals with the issue of fundamental limitations in filtering and 
control system design. This issue lies at the very heart of feedback theory 
since it reveals what is achievable, and conversely what is not achievable, 
in feedback systems. 

The subject has a rich history beginning with the seminal work of Bode 
during the 1940's and as subsequently published in his well-known book 
Feedback Amplifier Design (Van Nostrand, 1945). An interesting fact is that, 
although Bode's book is now fifty years old, it is still extensively quoted. 
This is supported by a science citation count which remains comparable 
with the best contemporary texts on control theory. 

Interpretations of Bode's results in the context of control system design 
were provided by Horowitz in the 1960's. For example, it has been shown 
that, for single-input single-output stable open-loop systems having rel- 
ative degree greater than one, the integral of the logarithmic sensitivity 
with respect to frequency is zero. This result implies, among other things, 
that a reduction in sensitivity in one frequency band is necessarily accom- 
panied by an increase of sensitivity in other frequency bands. Although 
the original results were restricted to open-loop stable systems, they have 
been subsequently extended to open-loop unstable systems and systems 
having nonminimum phase zeros. 

The original motivation for the study of fundamental limitations in 
feedback was control system design. However, it has been recently real- 
ized that similar constraints hold for many related problems including 
filtering and fault detection. To give the flavor of the filtering results, con- 
sider the frequently quoted problem of an inverted pendulum. It is well 




known that this system is completely observable from measurements of 
the carriage position. What is less well known is that it is fundamentally 
difficult to estimate the pendulum angle from measurements of the car- 
riage position due to the location of open-loop nonminimum phase zeros 
and unstable poles. Minimum sensitivity peaks of 40 dB are readily pre- 
dictable using Poisson integral type formulae without needing to carry out 
a specific design. This clearly suggests that a change in the instrumenta- 
tion is called for, i.e., one should measure the angle directly. We see, in this ex- 
ample, that the fundamental limitations point directly to the inescapable 
nature of the difficulty and thereby eliminate the possibility of expend- 
ing effort on various filter design strategies that we know, ab initio, are 
doomed to failure. 

Recent developments in the field of fundamental design limitations in- 
clude extensions to multivariable linear systems, sampled-data systems, 
and nonlinear systems. 

At this point in time, a considerable body of knowledge has been assem- 
bled on the topic of fundamental design limitations in feedback systems. 
It is thus timely to summarize the key developments in a modern and 
comprehensive text. This has been our principal objective in writing this 
book. We aim to cover all necessary background and to give new succinct 
treatments of Bode's original work together with all contemporary results. 

The book is organized in four parts. The first part is introductory and it 
contains a chapter where we cover the significance and history of design 
limitations, and motivate future chapters by analyzing design limitations 
arising in the time domain. 

The second part of the book is devoted to design limitations in feed- 
back control systems and is divided in five chapters. In Chapter 2, we 
summarize the key concepts from the theory of control systems that will 
be needed in the sequel. Chapter 3 examines fundamental design limita- 
tions in linear single-input single-output control, while Chapter 4 presents 
results on multi-input multi-output control. Chapters 5 and 6 develop cor- 
responding results for periodic and sampled-data systems respectively. 

Part III deals with design limitations in linear filtering problems. After 
setting up some notation and definitions in Chapter 7, Chapter 8 covers 
the single-input single-output filtering case, while Chapter 9 studies the 
multivariable case. Chapters 10 and 11 develop the extensions to the re- 
lated problems of prediction and fixed-lag smoothing. 

Finally, Part IV presents three chapters with very recent results on sen- 
sitivity limitations for nonlinear filtering and control systems. Chapter 12 
introduces notation and some preliminary results. Chapter 13 covers feed- 
back control systems, and Chapter 14 the filtering case. 

In addition, we provide an appendix with an almost self-contained re- 
view of complex variable theory, which furnishes the necessary mathe- 
matical background required in the book. 




Because of the pivotal role played by design limitations in the study of 
feedback systems, we believe that this book should be of interest to re- 
search and practitioners from a variety of fields including Control, Com- 
munications, Signal Processing, and Fault Detection. The book is self- 
contained and includes all necessary background and mathematical pre- 
liminaries. It would therefore also be suitable for junior graduate students 
in Control, Filtering, Signal Processing or Applied Mathematics. 

The authors wish to deeply thank several people who, directly or in- 
directly, assisted in the preparation of the text. Our appreciation goes 
to Greta Davies for facilitating the authors the opportunity to complete 
this project in Australia. In the technical ground, input and insight were 
obtained from Gjerrit Meinsma, Guillermo Gomez, Rick Middleton and 
Thomas Brinsmead. The influence of Jim Freudenberg in this work is im- 
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Introduction 




1 

A Chronicle of System Design 
Limitations 



1.1 Introduction 

This book is concerned with fundamental limits in the design of feedback 
control systems and filters. These limits tell us what is feasible and, con- 
versely, what is infeasible, in a given set of circumstances. Their signifi- 
cance arises from the fact that they subsume any particular solution to a 
problem by defining the characteristics of all possible solutions. 

Our emphasis throughout is on system analysis, although the results 
that we provide convey strong implications in system synthesis. For a va- 
riety of dynamical systems, we will derive relations that represent funda- 
mental limits on the achievable performance of all possible designs. These 
relations depend on both constitutive and structural properties of the sys- 
tem under study, and are stated in terms of functions that quantify system 
performance in various senses. 

Fundamental limits are actually at the core of many fields of engineer- 
ing, science and mathematics. The following examples are probably well 
known to the reader. 

Example 1.1.1 (The Cramer-Rao Inequality). In Point Estimation Theory, a 
function §(Y) of a random variable Y — whose distribution depends on an 
unknown parameter 0 — is an unbiased estimator for 0 if its expected value 
satisfies 



E e {§(Y)} = 0, 



( 1 . 1 ) 
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where Ee denotes expectation over the parametrized density function 
p(- ;0) for the data. 

A natural measure of performance for a parameter estimator is the co- 
variance of the estimation error, defined by Ee{(0 — 0) 2 }. Achieving a small 
covariance of the error is usually considered to be a good property of an 
unbiased estimator. There is, however, a limit on the minimum value of 
covariance that can be attained. Indeed, a relatively straightforward math- 
ematical derivation from (1.1) leads to the following inequality, which 
holds for any unbiased estimator, 

where p(- ; 0) defines the density function of the data y e Y. 

The above relation is known as the Cramer-Rao Inequality, and the right 
hand side (RHS) the Cramer-Rao Lower Bound (Cramer, 1946). This plays a 
fundamental role in Estimation Theory (Caines, 1988). Indeed, an estima- 
tor is considered to be efficient if its covariance is equal to the Cramer-Rao 
Lower Bound. Thus, this bound provides a benchmark against which all 
practical estimators can be compared. o 

Another illustration of a relation expressing fundamental limits is given 
by Shannon's Theorem of Communications. 

Example 1.1.2 (The Shannon Theorem). A celebrated result in Commu- 
nication Theory is the Shannon Theorem (Shannon, 1948). This crucial the- 
orem establishes that given an information source and a communication 
channel, there exists a coding technique such that the information can be 
transmitted over the channel at any rate R less than the channel capac- 
ity C and with arbitrarily small frequency of errors despite the presence 
of noise (Carlson, 1975). In short, the probability of error in the received 
information can be made arbitrarily small provided that 

R < C . (1.2) 

Conversely, if R > C, then reliable communication is impossible. When 
specialized to continuous channels, 1 a complementary result (known as 
the Shannon-Hartley Theorem) gives the channel capacity of a band-lim- 
ited channel corrupted by white gaussian noise as 

C = Blog 2 (l +S/N) bits/sec, 

where the bandwidth, B, and the signal-to-noise ratio, S/N, are the rele- 
vant channel parameters. 



1 A continuous channel is one in which messages are represented as waveforms, i.e., con- 

tinuous functions of time, and the relevant parameters are the bandwidth and the signal-to- 
noise ratio (Carlson, 1975). 
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The Shannon-Hartley law, together with inequality (1.2), are fundamen- 
tal to communication engineers since they (i) represent the absolute best 
that can be achieved in the way of reliable information transmission, and 
(ii) they show that, for a specified information rate, one can reduce the sig- 
nal power provided one increases the bandwidth, and vice versa (Carlson, 
1975). Hence these results both provide a benchmark against which prac- 
tical communication systems can be evaluated, and capture the inherent 
trade-offs associated with physical communication systems. o 

Comparing the fundamental relations in the above examples, we see 
that they possess common qualities. Firstly, they evolve from basic ax- 
ioms about the nature of the universe. Secondly, they describe inescapable 
performance bounds that act as benchmarks for practical systems. And 
thirdly, they are recognized as being central to the design of real systems. 

The reader may wonder why it is important to know the existence of 
fundamental limitations before carrying out a particular design to meet 
some desired specifications. Astrom (1996) quotes an interesting exam- 
ple of the latter issue. This example concerns the design of the flight con- 
troller for the X-29 aircraft. Considerable design effort was recently de- 
voted to this problem and many different optimization methods were 
compared and contrasted. One of the design criteria was that the phase 
margin should be greater than 45° for all flight conditions. At one flight 
condition the model contained an unstable pole at 6 and a nonminimum 
phase zero at 26. A relatively simple argument based on the fundamental 
laws applicable to feedback loops (see Example 2.3.2 in Chapter 2) shows 
that a phase margin of 45° is infeasible! It is interesting to note that many 
design methods were used in a futile attempt to reach the desired goal. 

As another illustration of inherently difficult problems, we learn from 
virtually every undergraduate text book on control that the states of 
an inverted pendulum are completely observable from measurements of 
the carriage position. However, the system has an open right half plane 
(ORHP) zero to the left of a real ORHP pole. A simple calculation based 
on integral sensitivity constraints (see §8.5 in Chapter 8) shows that sen- 
sitivity peaks of the order of 50:1 are unavoidable in the estimation of the 
pendulum angle when only the carriage position is measured. This, in 
turn, implies that relative input errors of the order of 1 % will appear as 
angle relative estimation errors of the order of 50%. Note that this claim 
can be made before any particular estimator is considered. Thus much wasted 
effort can again be avoided. The inescapable conclusion is that we should 
redirect our efforts to building angle measuring transducers rather than 
attempting to estimate the angle by an inherently sensitive procedure. 

In the remainder of the book we will expand on the themes outlined 
above. We will find that the fundamental laws divide problems into those 
that are essentially easy (in which case virtually any sensible design 
method will give a satisfactory solution) and those that are essentially 
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hard (in which case no design method will give a satisfactory solution). 
We believe that understanding these inherent design difficulties readily 
justifies the effort needed to appreciate the results. 



1.2 Performance Limitations in Dynamical 
Systems 



In this book we will deal with very general classes of dynamic systems. 
The dynamic systems that we consider are characterized by three key at- 
tributes, namely: 

(i) they consist of particular interconnections of a "known part" — the 
plant — and a "design part" — the controller or filter — whose struc- 
ture is such that certain signals interconnecting the parts are indica- 
tors of the performance of the overall system; 

(ii) the parts of the interconnection are modeled as input-output opera- 
tors 2 with causal dynamics, i.e., an input applied at time to produces 
an output response for t > to; and 

(iii) the interconnection regarded as a whole system is stable, i.e., a 
bounded input produces a bounded response (the precise definition 
will be given later). 



We will show that, when these attributes are combined within an appro- 
priate mathematical formalism, we can derive fundamental relations that 
may be considered as being systemic versions of the Cramer-Rao Lower 
Bound of Probability and the Channel Capacity Limit of Communications. 
These relations are fundamental in the sense that they describe achievable 
— or non achievable — properties of the overall system only in terms of 
the known part of the system, i.e., they hold for any particular choice of 
the design part. 

As a simple illustrative example, consider the unity feedback control 
system shown in Figure 1.1. 

To add a mathematical formalism to the problem, let us assume that 
the plant and controller are described by finite dimensional, linear time- 
invariant (LTI), scalar, continuous-time dynamical systems. We can thus 
use Laplace transforms to represent signals. The plant and controller can 
be described in transfer function form by G(s) and K(s), where 



G(s) = 



N G (s) 
D g (s) ’ 



K(s) — 



N k (s) 

Dk(s) 



(1.3) 



2 It is sufficient here to consider an input-output operator as a mapping between input 
and output signals. 





FIGURE 1.1. Feedback control system. 



The reader will undoubtedly know 3 that the transfer functions from ref- 
erence input to output and from disturbance input to output are given 
respectively by T and S, where 




Note that these are dimensionless quantities since they represent the 
transfer function (ratio) between like quantities that are measured in the 
same units. Also T(jtu) and S ( j cu) describe the response to inputs of a 
particular type, namely pure sinusoids. Since T(jcu) and S(jcu) are dimen- 
sionless, it is appropriate to compare their respective amplitudes to bench- 
mark values. At each frequency, the usual value chosen as a benchmark 
is unity, since T(jcuo) = 1 implies that the magnitude of the output is 
equal to the magnitude of the reference input at frequency u>o, and since 
S(jcuo) = 1 implies that the magnitude of the output is equal to the mag- 
nitude of the disturbance input at frequency o>o- More generally, the fre- 
quency response of T and S can be used as measures of stability robustness 
with respect to modeling uncertainties, and hence it is sensible to compare 
them to "desired shapes" that act as benchmarks. 

Other domains also use dimensionless quantities. For example, in Elec- 
trical Power Engineering it is common to measure currents, voltages, etc., 
as a fraction of the "rated" currents, voltages, etc., of the machine. This 
system of units is commonly called a "per-unit" system. Similarly, in Fluid 
Dynamics, it is often desirable to determine when two different flow sit- 
uations are similar. It was shown by Osborne Reynolds (Reynolds, 1883) 
that two flow scenarios are dynamically similar when the quantity 

R=al£. 

R 

3 See Chapter 2 for more details. 
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(now called the Reynolds number) is the same for both problems. 4 The 
Reynolds number is the ratio of inertial to viscous forces, and high values 
of R invariable imply that the flow will be turbulent rather than laminar. 
As can be seen from these examples, dimensionless quantities facilitate 
the comparison of problems with critical (or benchmark) values. 

The key question in scalar feedback control synthesis is how to find a 
particular value for the design polynomials N K and D K in (1.3) so that the 
feedback loop satisfies certain desired properties. For example, it is usu- 
ally desirable (see Chapter 2) to have T(jcu) = 1 at low frequencies and 
S(jcu) = 1 at high frequencies. These kinds of design goals are, of course, 
important questions; but we seek deeper insights. Our aim is to examine 
the fundamental and unavoidable constraints on T and S that hold irre- 
spective of which controller K is used — provided only that the loop is 
stable, linear, and time-invariant (actually, in the text we will relax these 
latter restrictions and also consider nonlinear and time-varying loops). 

In the linear scalar case, equations (1.5) and (1.4) encapsulate the key 
relationships that lead to the constraints. The central observation is that 
we require the loop to be stable and hence we require that, whatever value 
for the controller transfer function we choose, the resultant closed loop 
characteristic polynomial N G N K + D G D K must have its zeros in the open 
left half plane. 

A further observation is that the two terms N G N K and D G D K of the 
characteristic polynomial appear in the numerator of T and S respectively. 
These observations, in combination, have many consequences, for exam- 
ple we see that 

(i) S(s) + T(s) = 1 for all s (called the complementarity constraint); 

(ii) if the characteristic polynomial has all its zeros to the left of —a, 
where ex is some nonnegative real number, then the functions S and 
T are analytic in the half plane to the right of —a (called analyticity 
constraint); 

(iii) if q is a zero of the plant numerator N G (i.e., a plant zero), such that 
Re q > —a (here Re s denotes real part of the complex number s), 
then T(q) = 0 and S(q) = 1; similarly, if p is a zero of the plant de- 
nominator D g (i.e., a plant pole), such that Re q > — a,thenT(p) = 1 
and S(p) =0 (called interpolation constraints). 

The above seemingly innocuous constraints actually have profound im- 
plications on the achievable performance as we will see below. 



4 Here 
viscosity. 



i characteristic velocity, l a characteristic length, p the fluid density, and \± the 
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1.3 Time Domain Constraints 

In the main body of the book we will carry out an in-depth treatment 
of constraints for interconnected dynamic systems. However, to motivate 
our future developments we will first examine some preliminary results 
that follow very easily from the use of the Laplace transform formalism. 
In particular we have the following result. 

Lemma 1.3.1. Let H(s) be a strictly proper transfer function that has all its 
poles in the half plane Res < —a, where a is some finite real positive num- 
ber (i.e., H(s) is analytic in Re s > —a). Also, let h(t) be the corresponding 
time domain function, i.e.. 



H(s) =£H(t) , 



where £• denotes the Laplace transform. Then, for any so such that Re so > 
—a, we have 



e~ Sot h(t) dt = lim H(s) . 



Proof. From the definition of the Laplace transform we have that, for all 
in the region of convergence of the transform, i.e., for Re s > — a, 



H(s) • H e- st h(t) dt . 

Jo 

The result then follows since So is in the region of convergence of the trans- 
form. □ 



In the following subsection, we will apply the above result to examine 
the properties of the step responses of the output and error in Figure 1.1. 



1.3.1 Integrals on the Step Response 

We will analyze here the impact on the step response of the closed-loop 
system of open-loop poles at the origin, unstable poles, and nonminimum 
phase zeros. We will then see that the results below quantify limits in per- 
formance as constraints on transient properties of the system such as rise 
time, settling time, overshoot and undershoot. 

Throughout this subsection, we refer to Figure 1.1, where the plant and 
controller are as in (1.3), and where e and y are the time responses to a 
unit step input (i.e., r(t) = 1 , d(t) = 0, Vt). 

We then have the following results relating open-loop poles and zeros 
with the step response. 

Theorem 1.3.2 (Open-loop integrators). Suppose that the closed loop in 
Figure 1.1 is stable. Then, 
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(i) for lim s _>o sG(s)K(s) = ci, 0 < |ci | < oo, we have that 

lim eft) = 0 , 

[ e(t) dt = — ; 

Jo c i 

(ii) for lim s _>o s 2 G(s)K(s) = C 2 , 0 < IC 2 I < oo, we have that 

^lim e(t) = 0 , 

[ e(t) dt = 0 . 

Jo 



Proof. Let E, Y, R and D denote the Laplace transforms of e, y, r and d, 
respectively. Then, 

E(s)=S(s)[R(s)-D(s)], (1.6) 

where S is the sensitivity function defined in (1.5), and R(s) — D(s) = 1 /s 
for a unit step input. Next, note that in case (i) the open-loop system GK 
has a simple pole at s = 0, i.e., G (s)K(s) = L(s)/s, where lim s _>o Lfs) = C|. 
Accordingly, the sensitivity function has the form 



and thus, from (1.6), 

lim E(s) = — . (1.7) 

s— >0 Cl 

From (1.7) and the Final Value Theorem (e.g., Middleton and Goodwin, 
1990), we have that 



lim eft) = lim sEfs' 

t-»oo s— >0 

= 0 . 



Similarly, from (1.7) and Lemma 1.3.1, 

[ eft) dt = lim Efs) 

Jo s_ 



This completes the proof of case (i). 

Case (ii) follows in the same fashion, on noting that here the open-loop 
system GK has a double pole at s = 0. □ 
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Theorem 1.3.2 states conditions that the error step response has to sat- 
isfy provided the open-loop system has poles at the origin, i.e., it has pure 
integrators. The following result gives similar constraints for ORHP open- 
loop poles. 

Theorem 1.3.3 (ORHP open-loop poles). Consider Figure 1.1, and sup- 
pose that the open-loop plant has a pole at s = p, such that Rep > 0. 
Then, if the closed loop is stable, 

[°° e _pt e(t) dt = 0 , (1.8) 

Jo 

and 

PV pt p(t)dt = - . (1.9) 

Jo P 

Proof. Note that, by assumption, s = p is in the region of convergence of 
E(s), the Laplace transform of the error. Then, using (1.6) and Lemma 1.3.1, 
we have that 



e~ pt e(t) dt = E(p) 
o 

S(p) 

P 

= 0 , 

where the last step follows since s = p is a zero of S, by the interpolation 
constraints. This proves (1.8). Relation (1.9) follows easily from (1.8) and 
the fact that r = 1, i.e., 

JJ e pt y(t) dt 



P ' 



e- pt (r(t)-e(t)) dt 



= e- pt dt 
Jo 

1 



P 

A result symmetric to that of Theorem 1.3.3 holds for plants with non- 
minimum phase zeros, as we see in the following theorem. 

Theorem 1.3.4 (ORHP open-loop zeros). Consider Figure 1.1, and sup- 
pose that the open-loop plant has a zero at s = q, such that Re q >0. 
Then, if the closed loop is stable, 

[ e~ qt e(t) dt = — , 

Jo 9 



( 1 . 10 ) 
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and 

J°° e -qt y(t) dt = 0 . (1.11) 

Proof. Similar to that of Theorem 1.3.3, except that here T(q) = 0. □ 

The above theorems assert that if the plant has an ORHP open-loop pole 
or zero, then the error and output time responses to a step must satisfy in- 
tegral constraints that hold for all possible controller giving a stable closed 
loop. Moreover, if the plant has real zeros or poles in the ORHP, then these 
constraints display a balance of exponentially weighted areas of positive 
and negative error (or output). It is evident that the same conclusions 
hold for ORHP zeros and/or poles of the controller. Actually, equations 
(1.8) and (1.10) hold for open-loop poles and zeros that lie to the right 
of all closed-loop poles, provided the open-loop system has an integra- 
tor. Hence, stable poles and minimum phase zeros also lead to limitations in 
certain circumstances. 

The time domain integral constraints of the previous theorems tell us 
fundamental properties of the resulting performance. For example. The- 
orem 1.3.2 shows that a plant-controller combination containing a dou- 
ble integrator will have an error step response that necessarily overshoots 
(changes sign) since the integral of the error is zero. Similarly, Theo- 
rem 1.3.4 implies that if the open-loop plant (or controller) has real ORHP 
zeros then the closed-loop transient response can be arbitrarily poor (de- 
pending only on the location of the closed-loop poles relative to q), as we 
show next. Assume that the closed-loop poles are located to the left of —a, 
a > 0. Observe that the time evolution of e is governed by the closed-loop 
poles. Then as q becomes much smaller than a, the weight inside the in- 
tegral, e qt , can be approximated to 1 over the transient response of the 
error. Hence, since the RHS of (1.10) grows as q decreases, we can imme- 
diately conclude that real ORHP zeros much smaller than the magnitude 
of the closed-loop poles will produce large transients in the step response 
of a feedback loop. Moreover this effect gets worse as the zeros approach 
the imaginary axis. 

The following example illustrates the interpretation of the above con- 
straints. 

Example 1.3.1. Consider the plant 



rU] _ q-s 
( ) sfs+ir 

where q is a positive real number. For this plant we use the internal model 
control paradigm (Morari and Zafiriou, 1989) to design a controller in Fig- 
ure 1.1 that achieves the following complementarity sensitivity function 



T(s) = 



q(0.2s + 1 ) 2 
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This design has the properties that, for every value of the ORHP plant 
zero, q, (i) the two closed-loop poles are fixed at s = —5, and (ii) the er- 
ror goes to zero in steady state. This allows us to study the effect in the 
transient response of q approaching the imaginary axis. Figure 1.2 shows 
the time responses of the error and the output for decreasing values of 
q. We can see from this figure that the amplitude of the transients in- 
deed becomes larger as q becomes much smaller than the magnitude of 
the closed-loop poles, as already predicted from our previous discussion. 




FIGURE 1.2. Error and output time responses of a nonminimum phase plant. 



1.3.2 Design Interpretations 

The results of the previous section have straightforward implications con- 
cerning standard quantities used as figures of merit of the system's ability 
to reproduce step functions. We consider here the rise time, the settling time, 
the overshoot and the undershoot. 

The rise time approximately quantifies the minimum time it takes the 
system to reach the vicinity of its new set point. Although this term has 
intuitive significance, there are numerous possibilities to define it rigor- 
ously (cf. Bower and Schultheiss, 1958). We define it by 

t r = sup : y(t) < ^ for all t in [0, 6] | . (1.12) 

The settling time quantifies the time it takes the transients to decay below 
a given settling level, say e, commonly between 1 and 1 0%. It is defined 
by 

t s =inf|5:|y(t)-l|<e for all t in [6, oo) J . (1.13) 

Here, the step response of the system has been normalized to have unitary 
final value, which is also assumed throughout this section. 




14 



1. A Chronicle of System Design Limitations 



Finally, the overshoot is the maximum value by which the output exceeds 
its final set point value, i.e., 

y 0 s = sup{— e(t)} ; 

and the undershoot is the maximum negative peak of the system's output, 
y us = sup {— y (t)} . 

Figure 1.3 shows a typical step response and illustrates these quantities. 




Corollary 1.3.5 (Overshoot and real ORHP poles). A stable unity feed- 
back system with a real ORHP open-loop pole, say at s = p, must have 
overshoot in its step response. Moreover, if t r is the rise time defined by 
(1.12), then 

> (pt r — 1 )e ptr + 1 

I*' (1.14) 

>e!i. 

“ 2 

Proof. The existence of overshoot follows immediately from Theo- 
rem 1.3.3, since e(t) cannot have a single sign unless it is zero for all t. 
From the definition of rise time in (1.12) we have that y(t) < t/t r for 
t < t r , i.e., e(t) > 1 — t/t r . Using this, we can write from the integral 
equality (1.8) 




p, e(t) dt > 



(1.15) 
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From (1.15) and the definition of overshoot, it follows that 

Vo * f r 1=v °*E' rP,dt 

_ (pt r — 1 ) + e _ptr 
P 2 U 

Equation (1.14) is then obtained from (1.16) - (1.17). 

Corollary 1.3.5 shows that if the closed-loop system is "slow", i.e., it has 
a large rise time, the step response will present a large overshoot if there 
are open-loop unstable real poles 5 . Intuitively, we can deduce from this 
result that unstable poles will demand a "fast" closed-loop system — or 
equivalently, a larger closed-loop bandwidth — to keep an acceptable per- 
formance. The farther from the jtu-axis the poles are, the more stringent 
this bandwidth demand will be. 

An analogous situation is found in relation with real nonminimum 
phase zeros and undershoot in the system's response, as we see in the 
next corollary. 

Corollary 1.3.6 (Undershoot and real ORHP zeros). A stable unity feed- 
back system with a real ORHP open-loop zero, say at s = q, must have 
undershoot in its step response. Moreover, if t s and e are the settling time 
and level defined by (1.13), 



(1.16) 



(1.17) 

□ 



Vus 



1 -e 

e qt s _ i • 



(1.18) 



Proof. Similar to Corollary 1.3.5, this time using (1.11) and the definition 
of settling time and undershoot. □ 

The interpretation for Corollary 1.3.6 is that if the system has real non- 
minimum phase zeros, then its step response will display large under- 
shoots as the settling time is reduced, i.e., the closed-loop system is made 
"faster". Notice that this situation is quite the opposite to that for real un- 
stable poles, for now real nonminimum phase zeros will demand a short 
closed-loop bandwidth for good performance. Moreover, here the closer 
to the imaginary axis the zeros are, the stronger the demand for a short 
bandwidth will be. 

Evidently from the previous remarks, a clear trade-off in design arises 
when the open-loop system is both unstable and nonminimum phase. 



5 This is in contrast with the case of open-loop stable systems, where large overshoots 
normally arise from short rise times. 
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since, depending on the relative position of these poles and zeros, a com- 
pletely satisfactory performance may not be possible. The following result 
considers such a case. 

Corollary 1.3.7. Suppose a stable unity feedback system has a real ORHP 
open-loop zero at s = q and a real ORHP open-loop pole at s = p, p / q. 
Then, 



(i) if p < q, the overshoot satisfies 



F< 



q -p 



(ii) if p > q, the undershoot satisfies 



Proof. For case (i) combine (1.8) and (1.10) to obtain 

J°° (e~ pt — e~ qt ) [— e(t)] dt = ^ . 

Using the definition of overshoot yields 

U Vo. -e-’)dt 

0 Jo 



The result then follows from (1.19) by using the fact that q > p. 

Case (ii) can be shown similarly by combining (1.9) and (1.11) and using 
the fact that q < p. □ 

In the following subsection, we illustrate the previous results by ana- 
lyzing time domain limitations arising in the control of an inverted pen- 
dulum. This example will be revisited in Chapter 3, where we study 
frequency domain limitations in the context of feedback control, and in 
Chapter 8, where we analyze frequency domain limitations from a filter- 
ing point of view. 



2.3.3 Example: Inverted Pendulum 

Consider the inverted pendulum shown in Figure 1.4. The linearized 
model for this system about the origin (i.e., 0 = 0= y= p=O) has 
the following transfer function from force, u, to carriage position, y 

Y(s) (s — q)(s + q) 

U(s) M s 2 (s — p) (s + p) 



(1.20) 
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FIGURE 1.4. Inverted pendulum. 



where 



q = Vo/i, 

_ /( M + m)g 

P “ V Mi ' 

In the above definitions, g is the gravitational constant, m is the mass at 
the end of the pendulum, M. is the carriage's mass, and t is the pendulum's 
length. 

We readily see that this system satisfies the conditions discussed in 
Corollary 1.3.7, part (ii). Say that we normalize so that q = 1 and take 
m/M = 0.1, so that p = 1 .05. Corollary 1.3.7 then predicts an undershoot 
greater than 20! 




FIGURE 1.5. Position time response of the inverted pendulum. 
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To test the results, we designed an LQG-LQR controller 6 that fixes the 
closed-loop poles at s = -1,-2,— 3,— 4. Figure 1.5 shows the step re- 
sponse of the carriage position for fixed q = 1, and for different values 
of the mass ratio m/M (which imply, in turn, different locations of the 
open-loop poles of the plant). We can see from this figure that (i) the lower 
bound on the undershoot predicted by Corollary 1.3.7 is conservative (this 
is due to the approximation — y « y us implicitly used to derived this 
bound), and (ii) the bound correctly predicts an increase of the undershoot 
as the difference p — q decreases. 



1.4 Frequency Domain Constraints 

The results presented in §1.3 were expressed in the time domain using 
Laplace transforms. However, one might expect that corresponding re- 
sults hold in the frequency domain. This will be a major theme in the 
remainder of the book. To give the flavor of the results, we will briefly 
discuss constraints induced by zeros on the imaginary axis, or ORHP ze- 
ros arbitrarily close to the imaginary axis. Analogous conclusions hold for 
poles on the imaginary axis. 

Note that, assuming closed-loop stability, then an open-loop zero on the 
imaginary axis at jco q implies that 



T(jcu q )=0, and S(ju> q ) = l. (1.21) 



We have remarked earlier that a common design objective is to have 
S(jtu) 1 at low frequencies, i.e., for tu e [0, u>i] for some tui. Clearly, 
if u)q < cui, then this goal is inconsistent with (1.21). Now say that the 
open-loop plant has a zero at q = e + jcu q , where e is small and positive. 
Then we might expect (by continuity) that |S(jcu)| would have a tendency 
to be near 1 in the vicinity of tu = cu q . Actually, it turns out to be possible 
to force |S(jcu)l to be small for frequencies cu e [0, a>i] where a>i > tu q . 
However, one has to pay a heavy price for trying to defeat "the laws of na- 
ture" by not allowing |S(jco)| to approach 1 near cu q . Indeed, it turns out 
that the "price" is an even larger peak in |S(jtu)| for some other value of tu. 
We will show this using the continuity (analyticity) properties of functions 
of a complex variable. Actually, we will see that many interesting proper- 
ties of linear feedback systems are a direct consequence of the properties 
of analytic functions. 



6 See e.g., Kwakernaak and Sivan (1972). 
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Bode (1945) used analytic function theory to examine the properties of 
feedback loops in the frequency domain. At the time. Bode was working 
at Bell Laboratories. He used complex variable theory to show that there 
were restrictions on the type of frequency domain response that could be 
obtained from a stable feedback amplifier circuit. In particular, he showed 
— mutatis mutandis — that the sensitivity function, S, (defined in (1.5) for 
a particular case) must satisfy the following integral relation for a stable 
open-loop plant 



log |S(jtu)| dm = 0 . (1.22) 

Jo 

This result shows that it is not possible to achieve arbitrary sensitivity 
reduction (i.e., |S| < 1) at all points of the imaginary axis. Thus, if Sfjcu) is 
smaller than one over a particular frequency range then it must necessarily 
be greater than one over some other frequency range. 

Bode also showed that, for stable minimum phase systems, it was not 
necessary to specify both the magnitude and phase response in the fre- 
quency domain since each was determined uniquely by the other. 

Horowitz (1963) applied Bode's theorems to the feedback control prob- 
lem, and also obtained some preliminary results for open-loop unstable 
systems. These latter extensions turned out to be in error due to a missing 
term, but the principle is sound. 

Francis and Zames (1984) studied the feedback constraints imposed by 
ORHP zeros of the plant in the context of optimization. They showed 
that if the plant has zeros in the ORHP, then the peak magnitude of the 
frequency response of S(jcu) necessarily becomes very large if |S(jcu)| is 
made small over frequencies which exceed the magnitude of the zeros. 
This phenomenon has become known as the "water-bed" or "push-pop" 
effect. 

Freudenberg and Looze (1985) brought many of the results together. 
They also produced definitive results for the open-loop unstable case. For 
example, in the case of an unstable open-loop plant, (1.22) generalizes to 
(see Theorem 3.1.4 in Chapter 3) 



- log |S(jcu)| do) > ^ Pi > 



(1.23) 



where {pt : i = 1 , . . . , n p } is the set of ORHP poles of the open-loop plant. 
Equality is achieved in (1.23) if the set {pt : i = 1 , . . . , n p } also includes all 
the ORHP poles of the controller. 

In addition, Freudenberg and Looze expressed the integral constraints 
in various formats, both along the lines of Bode and in a different form 
using the related idea of Poisson integrals. In particular, the Poisson inte- 
grals permit the derivation of an insightful closed expression that displays 
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the water-bed effect experienced by nonminimum phase systems. This ex- 
pression, however, is not tight if the plant has more than one ORHP zero. 

About the same time, O'Young and Francis (1985) used Nevanlinna- 
Pick theory to characterize the smallest upper bound on the norm of the 
multivariable sensitivity function over a frequency range, with the con- 
straint that the norm remain bounded at all frequencies. This characteri- 
zation can be used to show the water-bed effect in multivariable nonmin- 
imum phase systems, and is tight for any number of ORHP zeros of the 
plant. Yet, no closed expression is available for this characterization but 
rather it has to be computed iteratively for each given plant. 

In 1987, Freudenberg and Looze extended the Bode integrals to scalar 
plants with time delays. In 1988 the same authors published a book that 
summarized the results for scalar systems, and also addressed the multi- 
variable case using singular values. 

In 1990, Middleton obtained Bode- type integrals for the complemen- 
tary sensitivity function T. For example, the result equivalent to (1.23), for 
an open-loop system having at least two pure integrators, is (see Theo- 
rem 3.1.5 in Chapter 3) 

^oglTIM^+fA, (1.24, 

where {q t : i = 1 , . . . , n q } is the set of ORHP zeros of the open-loop plant, 
and x is the plant pure time delay. 

Comparing (1.24) with (1.10) we see that (perhaps not unexpectedly) 
there is a strong connection between the time and frequency domain re- 
sults. Indeed, this is reasonable since the only elements that are being used 
are the complementarity, interpolation and analyticity constraints intro- 
duced in §1.2. 

Recent extensions of the results include multivariable systems, filter- 
ing problems, periodic systems, sampled-data systems and, very recently, 
nonlinear systems. We will cover all of these results in the remainder of 
the book. 



1.6 Summary 

This chapter has introduced the central topic of this book. We are con- 
cerned with fundamental limitations in the design of dynamical systems, 
limitations that are imposed by structural and constitutive characteristics 
of the system under study. As we have seen, fundamental limitations are 
central to other disciplines; indeed, we have provided as examples the 
Cramer-Rao Inequality of Estimation Theory, and the Shannon Theorem 
of Communications. 
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We have presented, through an example of scalar feedback control, two 
of the mappings that are central to this book, namely, the sensitivity and 
complementarity sensitivity functions. These mappings are indicators of 
closed-loop performance as well as stability robustness and, as such, it is 
natural to require that they meet certain desired design specifications. We 
argue that it is important to establish the limits that one faces when at- 
tempting to achieve these specifications before any design is carried out. 
For example, it is impossible for a stable closed-loop system to achieve 
sensitivity reduction over a frequency range where the open-loop sys- 
tem has a pure imaginary zero. More generally, ORHP zeros and poles 
of the open-loop system impose constraints on the achievable frequency 
response of the sensitivity and complementarity sensitivity functions. 

As a further illustration of these constraints, we have studied the ef- 
fect on the closed-loop step response of pure integrators and ORHP zeros 
and poles of the open-loop system. We have seen, inter-alia, that a sta- 
ble unity feedback system with a real ORHP open-loop zero must have 
undershoot in its step response. A similar conclusion holds with ORHP 
open-loop poles and overshoot in the step response. These limitations are 
obviously worse for plants having both nonminimum phase zeros and 
unstable poles; the inverted pendulum example illustrates these compli- 
cations. 

Finally, we have provided an overview of the published work that fo- 
cuses on systems design limitations, the majority of which build on the 
original work of Bode (1945). 



Notes and References 

Some of the studies of Bode seem to have been paralleled in Europe. For example, 
some old books refer to the Bode gain-phase relationship as the Bayard-Bode gain- 
phase relationship (e.g., Gille et al. (1959, pp. 154-155), Naslin (1965)), although 
precise references are not given. 

§1.3 is mainly extracted from Middleton (1991). 




Part II 



Limitations in Linear 
Control 




Review of General Concepts 



This chapter collects some concepts related to linear, time-invariant sys- 
tems, as well as properties of feedback control systems. It is mainly in- 
tended to introduce notation and terminology, and also to provide moti- 
vation and a brief review of the background material for Part II. The in- 
terested reader may find a more extensive treatment of the topics covered 
here in the books and papers cited in the Notes and References section at 
the end of the chapter. 

Notation. As usual, IN, R and C denote the natural, real and complex num- 
bers, respectively. DSIo denotes the set IN U {0}. The extended complex plane is 
the set of all finite complex numbers (the complex plane C) and the point 
at infinity, oo. We denote the extended complex plane by C e = C U {oo}. 
The real and imaginary parts of a complex number, s, are denoted by Re s 
and Im s respectively. 

We will denote by C + and C the open right and left halves of the com- 
plex plane, and by C+ and C their corresponding closed versions. Some- 
times, we will use the obvious acronyms ORHP, OLHP, CRHP, and CLHP. 
Similarly, the symbols ID and ID denote the regions inside and outside the 
unit circle |z| = 1 in the complex plane, and D and ID C their corresponding 
closed versions. 

The Laplace and Z transforms of a function f are denoted by £f and 
Zf, respectively. In general, the symbol s is used to denote variables when 
working with Laplace transforms, and z when working with Z transforms. 
Finally, we use lower case letters for time domain functions, and upper 
case letters for both constant matrices and transfer functions. 
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2.1 Linear Time-Invariant Systems 

A common practice is to assume that the system under study is linear 
time-invariant (LTI), causal, and of finite-dimension. 1 If the signals are as- 
sumed to evolve in continuous time, 2 then an input-output model for such 
a system in the time domain has the form of a convolution equation, 

y(t) - j h(t — t) u(t) dx , (2.1) 

where u and y are the system's input and output respectively. The func- 
tion h in (2.1) is called the impulse response of the system, and causality 
means that h(t) = 0 for t < 0. 

The above system has an equivalent state-space description 

x(t) = Ax(t) + Bu(t) , 
y(t) = Cx(t) + Du(t), 

where A, B, C, D are real matrices of appropriate dimensions. 

An alternative input-output description, which is of special interest 
here, makes use of the transfer function, 3 corresponding to system (2.1). 
The transfer function, H say, is given by the Laplace transform of h in 
(2.1), i.e., 

H(s) = J°° e- st h(t) dt . 

After taking Laplace transform, (2.1) takes the form 

Y(s) = H(s)U(s), (2.3) 



where U and Y are the Laplace transforms of the input and output signals 
respectively. 

The transfer function is related with the state-space description as fol- 
lows 

H(s) = C(sI-A)- 1 B + D , 
which is sometimes denoted as 



H = 



(2.4) 



1 For an introduction to these concepts see e.g., Kailath (1980), or Sontag (1990) for a more 
mathematically oriented perspective. 

2 Chapters 3 and 4 assume LTI systems in continuous time. Chapter 5 deals with period- 
ically time-varying systems in discrete time, and Chapter 6 with sampled-data systems, i.e., 
a combination of digital control and LTI plants in continuous time. 

3 Sometimes the name transfer matrix is also used in the multivariable case. 




2.1 Linear Time-Invariant Systems 



27 



We next discuss some properties of transfer functions. The transfer func- 
tion H in (2.4) is a matrix whose entries are scalar rational functions (due 
to the hypothesis of finite-dimensionality) with real coefficients. A scalar 
rational function will be said to be proper if its relative degree, defined as the 
difference between the degree of the denominator polynomial minus the 
degree of the numerator polynomial, is nonnegative. We then say that a 
transfer matrix H is proper if all its entries are proper scalar transfer func- 
tions. We say that H is biproper if both H and H 1 are proper. A square 
transfer matrix H is nonsingular if its determinant, det H, is not identically 

For a discrete-time system mapping a discrete input sequence, u k , into 
an output sequence, y k, an appropriate input-output model is given by 

Y(z) = H(z)U(z) , 

where U and Y are the Z transforms of the sequences Uk and yk, and are 
given by 

U(z) = Uk z- k , and Y(z) = Y_ Uk z ~ k > 

k=0 k=0 

and where H is the corresponding transfer matrix in the Z-transform do- 
main. All of the above properties of transfer matrices apply also to transfer 
functions of discrete-time systems. 



2.1.1 Zeros and Poles 



The zeros and poles of a scalar, or single-input single-output (SISO), transfer 
function H are the roots of its numerator and denominator polynomials 
respectively. Then H is said to be minimum phase if all its zeros are in the 
OLHP, and stable if all its poles are in the OLHP. If H has a zero in the 
CRHP, then H is said to be nonminimum phase-, similarly, if H has a pole in 
the CRHP, then H is said to be unstable. 

Zeros and poles of multivariable, or multiple-input multiple-output 
(MIMO), systems are similarly defined but also involve directionality 
properties. Given a proper transfer matrix H with the minimal realiza- 
tion 4 (A, B, C, D) as in (2.2), a point q e C is called a transmission zero 5 of 
H if there exist complex vectors x and T 0 such that the relation 



qI -c A :S 



(2.5) 



4 A minimal realization is a state-space description that is both controllable and observ- 
able. 

5 Since transmission zeros are the only type of multivariable zeros that we will deal with, 
we will often refer to them simply as "zeros". See MacFarlane and Karcanias (1976) for a 
complete characterization. 
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holds, where W*¥ 0 =l (the superscript V indicates conjugate transpose). 
The vector T 0 is called the output zero direction associated with q and, from 
(2.5), it satisfies H(q) =0. Transmission zeros verify a similar property 
with input zero directions, i.e., there exists a complex vector Tt, \ = 1, 
such that HfqjWi = 0. A zero direction is said to be canonical if it has only 
one nonzero component. 

For a given zero at s = q of a transfer matrix H, there may exist more 
than one input (or output) direction. In fact, there exist as many input (or 
output) directions as the drop in rank of the matrix H(q). This deficiency 
in rank of the matrix H(s) at s = q is called the geometric multiplicity of the 
zero at frequency q. 

The poles of a transfer matrix H are the eigenvalues of the evolution 
matrix of any minimal realization of H. We will assume that the sets of 
ORHP zeros and poles of H are disjoint. Then, as in the scalar case, H is 
said to be nonminimum phase if it has a transmission zero at s = q with q in 
the CRHP. Similarly, H is said to be unstable if it has a pole at s = p with p 
in the CRHP. By extension, a pole in the CRHP is said to be unstable, and 
a zero in the CRHP is called nonminimum phase. 

It is known (e.g., Kailath, 1980, p. 467) that if H admits a left or right 
inverse, then a pole of H will be a zero of H _1 . In this case we will refer to 
the input and output directions of the pole as those of the corresponding 
zero of H 1 . 

With a slight abuse of terminology, the above notions of zeros and poles 
will be used also for nonproper transfer functions, without of course the 
state-space interpretation. 

Finally, poles and zeros of discrete-time systems are defined in a simi- 
lar way, the stability region being then the open unit disk instead of the 
OLHP. In particular, a transfer function is nonminimum phase if it has ze- 
ros outside the open unit disk, B, and it is unstable if it has poles outside 
ID. 

For certain applications, it will be convenient to factorize transfer func- 
tions of discrete systems in a way that their zeros at infinity are explicitly 
displayed. 

Example 2.1.1. A proper transfer function corresponding to a scalar discrete- 
time system has the form 



H(z) = 



boz m + • • • + b m 
z n + aiz n_1 H 1- a n 



( 2 . 6 ) 



where n > m. Let 8 = n — m be the relative degree of H given above. Then 
H can be equivalently written as 



H(z) = H(z)z -6 , 



(2.7) 
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where H is a biproper transfer function, i.e., it has relative degree zero. 
Note that (2.7) explicitly shows the zeros at infinity of H. 6 o 

2 . 2.2 Singular Values 

At a fixed point s e C, let the singular value decomposition (Golub and 
Van Loan, 1983) of a transfer matrix H e C nxn be given by 

H(s) = ^ffi(H(^K(H(s))ui(H(s)) , 

i=1 

where Oi(H(s)) are the singular values of H(s), and are ordered so that ai > 
02 > • • • > CT n - Each set of vectors vt and Ui form an orthonormal basis of 
the space C n and are termed the left and right singular vectors, respectively. 
When the singular values are evaluated on the imaginary axis, i.e., for 
s = jcu, then they are called principal gains of the transfer matrix, and 
the corresponding singular vectors are the principal directions. Principal 
gains and directions are useful in characterizing directionality properties 
of matrix transfer functions (Freudenberg and Looze, 1987). 

It is well-known that the singular values of H can be alternatively deter- 
mined from the relation 

°f(H(s)) = A l (H*(s)H(s)) , (2.8) 

where At(H*H) denotes the i-th eigenvalue of the matrix H*H. We will 
denote the largest singular value of H by 0 (H), and its smallest singular 
value by cr(H). 

2 . 2.3 Frequency Response 

The frequency response of a stable system, is defined as the response in 
steady-state (i.e., after the natural response has died out) to complex si- 
nusoidal inputs of the form u = uo e iuJt , where Uo is a constant vector. It 
is well known that this response, denoted by y ss , is given by 

yss(t) = H(jcu) u 0 e ,tut . 

Hence, the steady-state response of a stable transfer function H to a com- 
plex sinusoid of frequency co is given by the input scaled by a "complex 
gain" equal to H (jcu). 

For scalar systems, note that H(jcu) = |H(ju))|e’ argH(jcu) . It is usual to 
call H ( j co ) the frequency response of the system, and | H ( j w ) | and arg H ( j tu ) 



6 Note that the transfer function H(z) has, including those at oo, the same number of zeros 
and poles, i.e., tv. In fact, a rational function assumes every value the same number of times 
(e.g., Markushevich, 1965, p. 163), 0 and 00 being just two particular values of interest. 
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the magnitude and phase frequency responses, respectively. Note that the 
magnitude frequency response gives the "gain" of H at each frequency, 
i.e., the ratio of output amplitude to input amplitude. It is a common 
practice to plot the logarithm of the magnitude response, 7 and the phase 
response versus co on a logarithmic scale. These are called the Bode plots. 

For multivariable systems, the extension of these concepts is not unique. 
One possible characterization of the gain of a MIMO system is by means of 
its principal gains, defined in §2.1.2. In particular, the smallest and largest 
principal gains are of special interest, since 

cx(H(jcu)) < < WH(jcu)) , (2.9) 

|u(ju))| 

where | • | denotes the Euclidean norm. Hence, the gain of H (understood 
here as the ratio of output norm to input norm) is always between its 
smallest and largest principal gains. 

A useful measure of the gain of a system is obtained by taking the supre- 
mum over all frequencies of its largest principal gain. Let H be proper 
transfer function with no poles on the imaginary axis; then the infinity 
norm of H, denoted by IIHy,*,, is defined as 

II H|| oo = sup cf(H(ja>)) . (2.10) 

For scalar systems a(H(jcu)) = H(jcu)|, and hence the infinity norm is 
simply the peak value of the magnitude frequency response. 

2.1.4 Coprime Factorization 

Coprime factorization of transfer matrices is a useful way of describing 
multivariable systems. It consists of expressing the transfer matrix in ques- 
tion as a "ratio" between stable transfer matrices. Due to the noncommu- 
tativity of matrices, there exist left and right coprime factorizations. We 
will use the notation "lcf" and "ref" to stand for left and right coprime 
factorization, respectively. 

The following definitions are reviewed from Vidyasagar (1985). 

Definition 2.1.1 (Coprimeness). Two stable and proper transfer matrices 
D , N (N , D) having the same number of rows (columns) are left (right) 
coprime if and only if there exist stable and proper transfer matrices Y, X 
(X, Y) such that 



NX + DY = I . (XN + YD = I .) 



frequently in decibels (dB), where |H|dB = 20 log 1 0 |H|. 




2.2 Feedback Control Systems 



31 



Definition 2.1.2 (Lcf, Ref). Suppose H is a proper transfer matrix. An or- 
dered pair, (D, N), of proper and stable transfer matrices is a lcf of H if D 
is square and det(D) f= 0,H = D 1 N, and D, N are right coprime. 

Similarly, an ordered pair (N , D ), of proper and stable transfer matrices 
is a ref of H if D is square and det(D) y 0, H = ND 1 ,and N, D are right 
coprime. o 

N and N will be called the numerators of the lcf or ref, respectively. Sim- 
ilarly, D and D will be called the denominators of the lcf or ref, respectively. 

Every proper transfer matrix admits left and right coprime factoriza- 
tions. Also, if H = D- 1 N = ND- 1 , then (Kailath, 1980, Chapter 6) 

• q is a zero of H if and only if N (s) (N(s)) loses rank at s = q. 

• p is a pole of H if and only if D(s) (D(s)) loses rank at s = p. 

Note that all of the concepts defined above apply to both continuous 
and discrete-time systems. In particular, for continuous-time systems, the 
factorizations are performed over the ring of proper transfer matrices with 
poles in the OLHP; on the other hand, for discrete-time systems, the fac- 
torizations are performed over the ring of proper transfer matrices with 
poles in the open unit disk. 



2.2 Feedback Control Systems 

Most of Part II is concerned with the unity feedback configuration of Fig- 
ure 2.1, where the open-loop system, L, is formed of the series connection of 
the plant, G, and controller, K, i.e., 

L = GK . 

In broad terms, the general feedback control problem is to design the con- 
troller for a given plant such that the output, y, follows the reference input, 
r, in some specified way. This task has to be accomplished, in general, 
in the presence of disturbances affecting the loop. Two common distur- 
bances are output disturbances, d, and sensor or measurement noise, w. The 
design generally assumes a nominal model for the plant, and then takes 
additional precautions to ensure that the system continues to perform in 
a reasonable fashion under perturbations of this nominal model. 

We consider throughout the rest of this chapter that the (nominal) plant 
and controller are continuous-time, linear, time-invariant systems, described 
by transfer functions G and K respectively. Some of these assumptions will 
be relaxed in other chapters. 




32 



2. Review of General Concepts 




FIGURE 2.1. Feedback control system. 

2 . 2.2 Closed-Loop Stability 

A basic requirement for a feedback control loop is that of internal stability, 
or simply closed-loop stability, according to the following definition. 

Definition 2.2.1 (Internal Stability). Let the open-loop system in Fig- 
ure 2.1 be given by L = GK. Then the closed loop is internally stable if 
and only if I + GK is nonsingular and the four transfer functions 

[ (I ; GK! ' —{I F gk: 'g 1 

[Ktl + GK)- 1 I — K(I + GK) -1 gJ ’ 

have all of their poles in the OLHP. o 

We say that L is free of unstable hidden modes if there are no cancelations 
of CRHP zeros and poles between the plant and controller whose cascade 
connection forms L. In the multivariable case, cancelations involve both 
location and directions of zeros and poles. For example, if the plant and 
controller are expressed using coprime factorizations as 

G = D g 1 N g =n g d g 1 , 

K = D k , Nk=N k D k 1 , 

then L = GK has an unstable hidden mode if D G and Nk share an ORHP 
zero with the same input direction (Gomez and Goodwin, 1995). It is easy 
to see that the closed loop is not internally stable if L has unstable hidden 
modes. 

For discrete-time systems, the above concepts apply with the correspond- 
ing definition of the stability region. 

2 . 2.2 Sensitivity Functions 

From Figure 2.1 we see that 

Y = D + L[R — W — Y] . 



Solving for Y we have 

Y = (I + L)- 1 D + L(I + L)- 1 [R - W] . 



( 2 . 11 ) 
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The above expression suggests that two functions of central interest in the 
design of feedback systems are the sensitivity function, S, and complemen- 
tary sensitivity function, T, given respectively by 

S(s) = [I + L(s)]^ 1 , and T(s) = L(s) [I + L(s)]^ 1 . (2.12) 

We see that S maps output disturbances to the output, and T maps both 
reference and sensor noise to the output. It is also straightforward to check 
that S also maps the reference input to the error in Figure 2.1. 8 In fact, S 
and T are intimately connected with closed-loop performance and robust- 
ness properties, as we show in the following subsections. 

2 . 2.3 Performance Considerations 

If the closed loop is internally stable, S and T are stable transfer functions. 
Then, the steady-state response of the system output to a disturbance d = 
d 0 e icut , for do € C n , is given by (cf. §2.1.3) 

Ud(t) = S(jcu)d 0 e jtut . 

Thus, the response to d can be made small by requiring |S(jco)dol -C 1. 
Clearly, from (2.9), the response of the system to output disturbances of 
any direction and frequency cu can be made small if 

cr(S(jcu)) « 1 . (2.13) 

A similar analysis for T shows that the response of the system to sensor 
noise of any direction and frequency w can be made small if 

btT(icu)] « 1 . (2.14) 

Recall that T also maps the reference input to the system output. It is 
thus clear that the feedback loop will have poor performance unless the 
frequency content of the reference input and the measurement noise are 
disjoint. This shows that there is an inherent trade-off between reference 
tracking and noise attenuation. 

Another trade-off arises between attenuation of output disturbances 
and sensor noise. Namely, the relationship S + T = I implies that the speci- 
fications (2.13) and (2.14) cannot be both satisfied over the same frequency 
range. 

The above discussion suggests that a sensible design should focus on 
achievable specifications. Consider, for example, the scalar case. If we as- 
sume that the reference input has low frequency content (which is typi- 
cally the case), then it is reasonable to require 

|T(ju>)| ss 1 , Vw 6 [0 , cut] , 



8 In the following chapters, d and w in this figure are frequently set to zero; the reader is 
asked to keep in mind that S and T also lead the output response to these signals. 
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for some cui . This is equivalent to 

|S(ju>)|«1, Vcu.etO.uq] . (2.15) 

Note that the above specification implies that output disturbances having 
frequency content in the range [0, u>i ] will be attenuated at the system 
output. However, making o>i too large may result in large magnitudes 
at the plant input. To see this, note that |S| — 1/|1 + L| can only be made 
small by making the magnitude of the open-loop system L = GK large. 
However, making the open-loop gain large over a frequency range where 
the gain of the plant |G| is small requires a high controller gain; hence, the 
response of the plant input to disturbances in this range will be very large, 
usually leading to saturation. We conclude that the range of sensitivity 
reduction (and thus of reference tracking) is limited by the plant's input 
response to disturbances. 

It is then common to aim at a design that achieves specifications of the 
form 



|S(jco)| <C 1 , Vco e [0, cui] , 

rtM«1, Vme[m 2 ,oo), 

for some o >2 > u>i . Typical shapes for S and T satisfying specifications of 
this kind are shown in Figure 2.2. 




FIGURE 2.2. Typical shapes for |S(jtu)| and |T (jtu)|. 



If the above requirements are satisfied, then the peak values of S and T 
will occur in the intermediate range (mi , m 2 ). It is desirable to keep these 
peaks as small as possible in order to avoid overly large sensitivity to dis- 
turbances and excessive influence of sensor noise. A key point to emerge 
later in the book, however, is that nonminimum phase zeros and unsta- 
ble poles of the open-loop system impose lower limits on the achievable 
peaks of the sensitivity and complementary sensitivity functions. 
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2 . 2.4 Robustness Considerations 

If the actual plant, G say, differs from the nominal model G, then ad- 
ditional requirements are needed to preserve stability and good perfor- 
mance. The usual procedure is to consider a particular model for the al- 
lowable perturbations (usually based on practical considerations), and then 
to impose a condition on the design that will guarantee robust stability 
(and/or performance) for all perturbed plants within the set of models 
having the allowable perturbations. 

Two common models used to describe plant uncertainty are divisive 
and multiplicative perturbation models. The (input) divisive perturbation 
model, or perturbation of the plant inverse, assumes that 

G = G(I + A) -1 , (2.16) 

where A is a stable transfer function satisfying a frequency dependent 
magnitude bound 

a(A(jcu)) < W(cu), Vcu . (2.17) 

The (output) multiplicative perturbation model assumes that 

G = (I + A)G , (2.18) 

where A is a stable transfer function satisfying a frequency dependent 
magnitude bound similar to (2.17). If this is the only information avail- 
able about the uncertainty, then A is termed unstructured uncertainty. 

It turns out that the sensitivity and complementary sensitivity functions 
each characterize stability robustness of the system against divisive and 
multiplicative plant uncertainty respectively. Indeed, the feedback system 
will be stable for all plants described by (2.16), (2.17), with A stable, if and 
only if the system is stable when A = 0 and 

cf(S(jcu)) < 1/W(o>) , Vcu, (2.19) 

where W is the bound in (2.17). 

Similarly, if the nominal closed loop is stable, then the perturbed closed 
loop will remain stable for all plants described by (2.18), (2.17), with A 
stable, if and only if 

a(T(jcu)) < 1/W(cu) , Vcu. (2.20) 

We remark that the same condition (2.19) is also necessary and sufficient 
for robust stability against additive perturbations of the open-loop of the 
form L = L + A, where A is stable and satisfies (2.17). 

Note that specifications such as (2.19) and (2.20) give more insights into 
the desirable shapes for S and T. For example, in the scalar case, a typical 
bound W(cu) for multiplicative perturbation grows at high frequencies. 9 



9 The multiplicative perturbation model is useful to describe high frequency modelling 
inaccuracy, common in practice (Doyle and Stein, 1981). 
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Thus, robust stability against multiplicative uncertainty requires that |T (j to ) | 
be small at high frequencies. 

Finally, we briefly turn to performance robustness considerations. We 
have seen in §2.2.3 that S and T are indicators of feedback system perfor- 
mance. We will next consider how these functions are affected by plant 
variations. We focus on the scalar case but similar conclusions hold, mu- 
tatis mutandis, for multivariable systems. 

Assume that the loop gain changes from its nominal value L to its actual 
value L. It is not difficult to show that the relative changes in the sensitivity 
and complementary sensitivity functions are given by 



S-S L-L 

S L ’ 



These relations show that the sensitivity function will be robust with re- 
spect to changes in the loop gain in those frequency ranges where the 
nominal complementary sensitivity is small (typically at high frequen- 
cies); conversely the complementary sensitivity will be robust with respect 
to changes in the loop gain in those frequency ranges where the nominal 
sensitivity is small (typically at low frequencies). 



2.3 Two Applications of Complex Integration 

In the previous section we discussed the importance of attaining a desired 
shape for the frequency response of relevant transfer functions of feed- 
back control loops. As we will see later, zeros and poles of the plant to be 
controlled impose restrictions on the behavior of these functions at partic- 
ular complex frequencies in the ORHP. A powerful tool exists by means 
of which these restrictions in the ORHP can be transformed directly into 
equivalent constraints on the frequency response. Indeed, the imaginary 
axis can be looked upon as the boundary of the ORHP, which is the region 
where the special restrictions on the transfer functions occur, so that the 
broad mathematical problem is that of relating the behavior of a function 
inside a region to its behavior on the boundary of the region. A mechanism 
for this purpose is found in Cauchy's theory of analytic functions and its 
integrals around closed contours. The remainder of the book will make 
extensive use of this theory, and a self-contained review of this theory is 
given in Appendix A for convenience. 

As a preliminary use of Cauchy's theory of complex integration, we will 
present two well-known applications. First we will establish the Nyquist 
stability theorem. We treat the continuous-time case; however, similar ar- 
guments apply to the discrete-time problem. As a second application, we 
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will derive the Bode gain-phase relationship. The latter relationship will 
also serve as an introduction to the constraints introduced by nonmini- 
mum phase zeros on the achievable shape of the frequency response. 



2.3.2 Nyquist Stability Criterion 

The Nyquist criterion depends on a result known as the Principle of the 
Argument. This result uses the residue theorem (Theorem A.9.1 in Ap- 
pendix A) to obtain information about the number of zeros of an analytic 
function (or about the number of zeros minus the number of poles of a 
meromorphic function. 10 

Theorem 2.3.1 (Principle of the Argument). Let C be a closed simple con- 
tour contained in a simply connected domain D. Let f be a meromorphic 
function in D and suppose that f has no zeros or poles on C. Let n q be 
the number of zeros and n p the number of poles of f in the interior of C, 
where a multiple zero or pole is counted according to its multiplicity. Then 

£ £si ds ~ * in ^ nq ~ np ) ’ ( 2 - 21 ) 

where f 1 denotes the derivative of f, and integration in (2.21) is performed 
in the counter-clockwise direction. 



Proof. The only possible singularities of the meromorphic function f'/f 
inside C are the zeros and poles of f. Suppose that so represents a zero or 
pole of f with multiplicity n. We can write 

f(s) = (s - S 0 ) n f(s) , (2.22) 

where f is analytic in a neighborhood of So and f(so) f 0. Hence 



f'(s) = n f'(s) 

f(s) s-s 0 f (s) 



(2.23) 



in a neighborhood of s 0 . Thus the residue of f'/f at so is n (see §A.9.1 in 
Appendix A). Note that n is positive if so is a zero of f, and n is negative if 
so is a pole of f . Applying Theorem A.9.1 of Appendix A yields (2.21) and 
completes the proof. D 

We will next see why Theorem 2.3.1 is called the principle of the argu- 
ment. Let the equation for C be s = s(£), with £ in [a, b] and let £, = f (s). 
Consider now the image of C under f, C say. Thus, the equation of C in 
the £, plane is 

£, = f(s(£)) , £e[a,b]. 



10 A function is meromorphic in a domain D if it is defined and analytic in D except for 
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Since f is never zero on C, then the curve C does not pass through the 
origin of the £, plane. Hence, it is possible to define a continuous logarithm 



F(C)=logf(s(0) 

on C. On any smooth portion of C, we have, by differentiation, 

f'(c| = f * s ^V(c) , 

f(s(0) ^ ’ 

and hence, by the fundamental theorem of calculus (cf . (A.18) in Appendix A), 

r b f ; (s(o) , 



Ja f(s( 0) 



s'(0 dC = logf(s(0) 



This is equivalent to 

| y^-ds =logf(s)| = log |f(s)| I +jargf(s)| . 

Jc ns) | C lc Ic 

The first term on the right is zero since C is closed. Then, dividing by 27t 
and using (2.21), we get 



27t(n q -Up) =argf(s) . (2.24) 

Ic 

That is, u q — n p is the number of times the image curve C winds around 
the origin in the f, plane, when C is traversed in the counter-clockwise 
sense. 

The principle of the argument finds immediate application in the Nyquist 
stability criterion. Specifically, let L = GK be the open-loop transfer func- 
tion of the feedback control system shown in Figure 2.1. Assume further 
that L is scalar. We have seen in §2.2.1 that the closed loop is internally 
stable if and only if there are no unstable cancelations in L, L(oo) / — 1, 
and all the zeros of the characteristic equation 

1 + L(s) = 0 (2.25) 



have negative real part. 

Consider next the contour C shown in Figure 2.3, consisting of the imag- 
inary axis and a semicircle of infinite radius into the ORHP. If L has poles 
on the imaginary axis, then C must have small indentations to avoid them. 
Such a contour is called Nyquist contour and its image through L(s) is 
called the Nyquist plot of L. 

A necessary and sufficient condition for closed-loop stability is furnished 
by the following theorem. 
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FIGURE 2.3. Nyquist contour. 

Theorem 2.3.2 (Nyquist Stability Criterion). The feedback control sys- 
tem of Figure 2.1 is internally stable if and only if L(oo) ^ —1 and the 
number of counter-clockwise revolutions made by the Nyquist plot of the 
open-loop transfer function L = GK around the point s = — 1, is equal to 
the number of unstable poles of G plus the number of unstable poles of K. 

Proof. We apply Theorem 2.3.1 to the function f = 1 + L using the Nyquist 
contour, C in Figure 2.3 (note that now integration is in the clockwise di- 
rection). Any pole or zero of 1 + L with positive real part will therefore lie 
within this contour. Thus, closed-loop stability is equivalent to n q = 0 in 
(2.21) or (2.24). 

It follows from (2.24) that the phase-shift increment of 1 + L(s) as s tra- 
verses the Nyquist contour is 2n (n p — n q ), where n p is the number of un- 
stable poles of L. But, since L and 1 +L have the same poles, it is equivalent 
to count revolutions of L(s) around the point (—1 , 0). Thus the number of 
counter-clockwise revolutions of the Nyquist plot of L = GK around the 
point s = — 1 is different from the number of unstable poles of G plus the 
number of unstable poles of K if and only if there is an unstable cancela- 
tion in L, or 1 + L is nonminimum phase (i.e., n q f 0). The result then 
follows. □ 

Example 2.3.1. Let L in Figure 2.1 be a strictly proper transfer function. 
Since L(Re i0 ) vanishes as R becomes infinite, it follows that the phase-shift 
of 1 + L(s) as s traverses the Nyquist contour is given by its phase-shift 
when s moves on the imaginary axis. Moreover, since L has real coeffi- 
cients, then it suffices to consider 2 times the phase-shift encountered as s 
moves along the positive imaginary axis. Also, note that 1 + L(jcu) is the 
vector from the —1 point to the point on the Nyquist plot at frequency u>. 

Now assume that L is strictly proper and has one unstable pole. Ac- 
cording to the Nyquist stability criterion and the previous discussion, if 
the closed loop is stable, then the vector 1 + L(jcu) must rotate an angle 
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of 7 t (in the counter-clockwise sense) as to goes from 0 to oo. But, since L 
is strictly proper, 1 + L(joo) is the vector from the —1 point to the origin 
of the complex plane. It thus follows that closed-loop stability requires 
L(0) < — 1 . 



2 . 3.2 Bode Gain-Phase Relationships 

As a further application of analytic function theory, we will review the 
gain-phase relationships originally developed by Bode (1945), which es- 
tablish that, for a stable minimum phase transfer function, the phase of 
the frequency response is uniquely determined by the magnitude of the 
frequency response and vice versa. 

We begin by showing that the real and imaginary parts of a proper sta- 
ble rational function with real coefficients are dependent of each other. We 
consider this dependence at points of the imaginary axis. 

Theorem 2.3.3 (Bode's Real-imaginary Parts Relationship). 11 Let H be a 

proper stable transfer function, and suppose that, at s = jcu, H(s) can be 
written as H(jto) = U(u>) + jV(cu), where U and V are real valued. Then 
for any coo 

,,, . 2 o ) 0 f°° U(u>) — U(coo) . 

V(cuo) = 5 2 du) • (2-26) 

7T J 0 UA-U)g 



Proof. Let C be the clockwise oriented contour shown in Figure 2.4, and 
consisting of the imaginary axis, with infinitely small indentations at the 
points Tjcuo and -jcu 0 (C 2 and C 3 in Figure 2.4), and the semicircle Ci, 
which has infinite radius in the ORHP 12 . 

Then the functions 

H(s)-U(cu 0 ) , H(s) — U(co 0 ) 

; and ; 

s — )O>0 s + ]COo 

are analytic on and inside C. Hence, applying Cauchy's integral theorem 
(see §A.5.2 in Appendix A) to both functions and subtracting yields 



t / H(s) — U(cu 0 ) H(s) — U(cu 0 ) \ 
Jc V s-jcuo s + jcuo ) 

The integral above may be decomposed as 
H(jcu) -U(coq) 



2cu 0 



dco + Ii + I 2 + I 3 = 0 , 



(2.27) 



(2.28) 



11 This is, in fact, one of the many real-imaginary relationships derived by Bode . 

12 This should be understood as follows: the indentations on the imaginary axis have radii 
p > 0, and the large semicircle in the ORHP has finite radius R. These are then considered 
in the limit as p — > 0 and R — s oo. In fact, the large semicircle is nothing but an indentation 
around oo. 
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FIGURE 2.4. Contour used in Theorem 2.3.3. 



where Ii , h, and I3 are the integrals over Ci , £2, and C3 respectively. The 
integral on the imaginary axis can be written as 



H(jcu) -U(ujo) 



since the real and imaginary parts of a transfer function evaluated at s = 
jcu are even and odd functions of tu respectively. 

Next note that the integral Ii vanishes because H is proper. 

Now consider the integral I2. Since the radius of £2 is infinitely small, 
we can approximate H(s) on C2 by the constant H(jcuo). We can also ne- 
glect the contribution of the fraction 1 /(s + j cu ) in comparison with that of 
l/(s — jcu). Then 



= f H(jco 0 ) — U(cuq) ds 
Jc 2 s-jcuo 

= }V(cu 0 ) [ 2 — V— ds 

Jc 2 s — i^o 

= — 7tV(cU 0 ) , 



where the last step follows from (A. 32 ) in Appendix A. 

Similarly, we can show that the integral I3 equals — 7tV(cuo). Finally, sub- 
stituting into ( 2 . 28 ) and rearranging gives the desired expression. □ 

The above theorem shows that values on the jcn-axis of the imaginary 
part of a stable and proper transfer function can be reconstructed from 
knowledge of the real part on the entire j co-axis. Conversely, under the 
assumption that the transfer function is strictly proper and stable, it can be 
shown that the real part can be obtained from the imaginary part, i.e., 

2 r°° co[V(u))-V(co 0 )] 
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which follows similarly by adding instead of subtracting in (2.27). 

It is shown in §A.6 of Appendix A that the values of a function analytic 
in a given region can be reconstructed from its values on the boundary. 
Combining this with relations (2.26) and (2.29), we deduce that the val- 
ues of a stable and strictly proper transfer function on the CRHP are com- 
pletely determined by the real or imaginary part of its frequency response. 

We will next show that the gain and the phase of the frequency response 
of a stable, minimum phase transfer function are dependent on each other. 
Theorem 2.3.4 (Bode's Gain-phase Relationship). Let H be a proper, sta- 
ble, and minimum phase transfer function, such that H(0) > 0. Then, at 
any frequency too, the phase 4>(cu 0 ) — arg Hfjcuo) satisfies 

<M«) = 1 f dl ° SlH , lla, ° eU|1 logcolh H du , (2.30) 

7T J-oq). du 12 1 

where u = log(cu/coo). 



Proof. Consider 

H(jcuo) = U(co 0 ) + jV(co 0 ) = |H(ju) 0 )l . (2.31) 



Since H has no zeros in the CRHP, taking logarithms in (2.31) gives 

logH(jcuo) = log |H(jco 0 )| + j4>(u) 0 ) = m(tuo) + j4>(cu> 0 ). (2.32) 



Comparing (2.31) and (2.32) shows that the magnitude characteristic m(too) 
and the phase 4>(co 0 ) are related to logH(jcuo) and to each other in the 
same way that U(coo) and V(tuo) are related to H(jtuo) and each other. 
Hence (2.29) and (2.26) immediately imply 



m(cuo) = 


-!p 


UJ [ct>(uj) — 4»(UJ 0 )] 
i 1 do» , 


(2.33) 




7T Jo 


W 2 -iV 2 0 


(J>(cuo) = 


2c Up p 

7T Jo 


3 m(cu) -m(cu 0 ) 

a 5 dO) . 

o > 2 -“>o 


(2.34) 



Note that the assumption that H has no zeros or poles in the CRHP guar- 
antees the validity of the integrals above, since log H is analytic in the 
finite CRHP. The singularity at oo arising from a strictly proper H is ruled 
out in the chosen contour of integration (see footnote 12 on page 40). The 
fact that | log H(s)|/|s| — > 0 when |s| — > oo eliminates the integral along the 
large semicircle in the ORHP. 

Next, consider (2.34). Changing variables to u = log(a>/a> 0 ) and denot- 
ing m(u) = m(cu) gives 



(j>(u;o) = ^J 

-if 



sinh(u) 
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Dividing the complete range of integration into separate ranges above and 
below u = 0 and integrating by parts yields 



(MtOo) 



= 1_ r° m(u) -m(coo) du + 1 f 00 m(u) -m(cu 0 ) ^ 
sinh(u) 7tJ 0 sinh(u) 

1 ✓ ^ \ 1 0 
= - — [m(u) - m(co 0 )] logcoth y—j | 



.l|j^ logcoth (-) du 



- ^ [frv(u) - m(co 0 )] logcoth | 



(2.35) 



Near u = 0, the quantity m(u) — m(co 0 ) behaves proportionally to u, 
whilst logcoth(u/2) will vary as — log(u/2). Thus, at the limit u — > 0, the 
integrated portions of (2.35) behave as u logu, which is known to van- 
ish as u — > 0. As for the other limits, we have that lim u _ ) _ 00 m(u) = 
linia^o rn(co) = m(0), which is finite since H is stable and minimum 
phase; also limu^oo fn(u) log coth(u/2) = lima,-,,*, m(co)2(coo/co) = 0. 
Hence both integrated portions in (2.35) are equal to zero. The result then 
follows on combining the remaining two integrals in (2.35). □ 

The implications of (2.30) can be easily appreciated using properties of 
the weighting function appearing in (2.30), namely 

logcoth|^|=log| CU + a, ° | . (2.36) 

12 1 | a> — coo | 

This function is plotted in Figure 2.5. 

As we can see from this figure, the weighting function becomes logarith- 
mically infinite at the point cu = mo- Thus, we conclude from (2.30) that 
the slope of the magnitude curve in the vicinity of o>o, say c, determines 
the phase c(>(cjuo): 



4>(co 0 ) ~ [ logcoth 1^1 du = = c^ . 

7t J-oo 12 1 7T 2 2 

Hence, for stable and minimum phase transfer functions, a slope of 20c 
dB /decade in the gain in the vicinity of o> 0 implies a phase angle of ap- 
proximately c 7t/2 rad sec -1 . 

The above arguments lead classical designers to conclude that, to ensure 
closed-loop stability, the slope of the open-loop gain characteristic, |L(jcu)|, 
should be in the range -20 to -30 dB/ decade at the gain cross-over point 
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FIGURE 2.5. Weighting function of the Bode gain-phase relationship. 



(i.e., at the frequency at which |L| = 1 or 0 dB), since this would imply the 
phase would be less than 1 80° i.e. the Nyquist plot would not encircle the 
‘-Y point. 

Example 2.3.2. Let us consider the X-29 aircraft design example discussed 
in §1.1 of Chapter 1. This system is (approximately) modelled by a strictly 
proper transfer function, G, which is unstable and nonminimum phase. 
For one flight condition, the unstable pole is at 6 and the nonminimum 
phase zero at 26. It is desired to use a stable, minimum phase controller in 
series with G, such that the closed loop is stable and has a phase margin 
of 7t/4. Consider the open-loop system formed by the cascade of plant and 
controller and modeled by a transfer function, L say. This system is neither 
stable nor minimum phase in open loop. However, we can associate with 
L another transfer function, L, defined as follows 

qs)= -I (s) (i±£)(i_S), (2 .37, 

where L is stable, minimum phase, and such that L(0) > 0, and where p 
and q correspond to the (real) ORHP pole and zero of G respectively. 13 
The negative sign in (2.37) is necessary to guarantee a stable closed loop 
(see Example 2.3.1). We note that 

|L(jto)| = |L(jcu)| . (2.38) 

Now from (2.37) we have that 4>(^>o) — argL(jcuo) is given by 

, , , , p-jcuo j^o + q 

4)(o>o) = arg L()co 0 ) — arg — — arg : . 

P + W °jco 0 -q 



13 Actually, the device used above to associate a stable, minimum phase transfer function 
with an unstable, nonminimum phase one will be used repeatedly in subsequent chapters. 
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Also, since L is stable, minimum phase, and L(0) > 0, we can use (2.30) to 
obtain 



<j>(co 0 ) = 



1 

7T 



5 dlog |L(ju) 0 e n ) 



log coth | ^ | 



du— arg 



(p— jcuo)(jaj 0 +q) 
(p+ju) O )0u) O -q) ' 



Finally, using (2.38) we obtain 



= 1 f” dlog|L(ju W “)l 
du 

_ JT 00 dlog |L(jcu 0 e u )| 

^ J— oo 



log coth |^| 
log coth |^| 



du— arg 
du— 2ar 



(p-ja)o)(ja) 0 + q) 
(p+jtoo)(ju> 0 -q) 
wo/q+y/wp 

c an i -p/q 



Say that we want a slope of -10 dB /decade at the gain cross-over fre- 
quency; then this means that the first term in the above expression is ap- 
proximately — 7t/4. Now, the second term has its least negative value for 
cu 0 = \Zpq, and for p = 6, q = 26, we obtain 



c|)(cuo) < (— 7t/4— 1.79)rad 
= -147° . 



Hence, the maximum possible phase margin in this case is 33°. 



2.4 Summary 

In this chapter we have provided an overview of system properties, with 
emphasis on the frequency response of LTI systems. We have considered 
stability, performance and robustness of feedback control loops. We have 
also shown that the sensitivity and complementary sensitivity functions 
can be used to quantify important feedback properties. 

In addition, we have given two applications of Cauchy's integral the- 
orems to systems theory, namely the Nyquist stability criterion and the 
Bode gain-phase relationship. 



Notes and References 

This chapter is mainly oriented towards people with some background in con- 
trol and systems theory. For a more extensive introduction see e.g., Kailath (1980), 
Franklin et al. (1994) or Sontag (1990). The material included here was based on 
the references below. 

LTI Systems 

See e.g., Francis (1991), Maciejowski (1991), Middleton and Goodwin (1990), Kailath 
(1980) and Franklin et al. (1994). 
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Feedback Control Systems 

See e.g., Freudenberg and Looze (1988), Doyle and Stein (1981), Maciejowski (1991) 
and Kwakernaak (1995). 

A different approach to the concept of gains for multivariable systems is found 
in Postlethwaite and MacFarlane (1979), where emphasis is placed on the (fre- 
quency dependent) eigenvalues of the transfer matrix. 

§2.3 is mainly based on Bode (1945). 

Example 2.3.2 is taken from Astrom (1996), where additional limitations on the 
achievable phase margin are also discussed. 




3 

SISO Control 



In this chapter we present results on performance limitations in linear 
single-input single-output control systems. These results are the corner- 
stones of classical design. We focus on the sensitivity and complementary 
sensitivity functions, S and T. Although this chapter is based on contri- 
butions by many authors, mainly during the 80's, they may be seen with 
justice as direct descendants of the many ideas contained in Bode (1945). 



3.1 Bode Integral Formulae 

Bode's book (Bode, 1945) mainly dealt with analysis and design of feed- 
back amplifiers, but it settled the mathematical foundation for what is 
now known as classical control theory. Bode's methods had a deep and 
lasting impact in systems science, and many of his results still have reper- 
cussions. From his analysis, for example, it can be concluded (see §3.1.2) 
that, if the open-loop system is a stable rational function with relative de- 
gree at least two, then, provided the closed-loop system is stable, the sen- 
sitivity function must satisfy the following integral relation: 

J log |S(jcu)|du> = 0 . (3.1) 

This integral establishes that the net area subtended by the plot of |S(jcu)| 
on a logarithmic scale is zero. Hence, the contribution to this area of those 
frequency ranges where there is sensitivity amplification (|S(jco)| > 1) 
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must equal that of those ranges where there is sensitivity attenuation (|S(jco)| < 
1). This trade-off is illustrated in Figure 3.1. This demonstrates that there 
is a compromise between sensitivity magnitudes in different frequency 
ranges. Moreover, since the sensitivity function quantifies (amongst other 
things) a system's ability to reject disturbances, the area constraint estab- 
lishes that it is impossible to achieve arbitrary rejection at all frequencies. 




FIGURE 3.1. Area balance of the sensitivity integral. 



Due to the aforementioned balance of areas, the relation (3.1) is some- 
times called the area formula. As a matter of fact, (3.1) is a control sys- 
tem interpretation due to Horowitz (1963) of the original results of Bode 
(1945). These results dealt with the application of Cauchy's integral the- 
orem (Theorem A.5.3 in Appendix A) to the real and imaginary parts of 
analytic functions (some of them have already been discussed in §2.3.2 of 
Chapter 2). In the following subsection we review the original formula of 
Bode that inspired (3.1). 



3.1.1 Bode's Attenuation Integral Theorem 

The theorem that we present in this section further develops the relation- 
ship between real and imaginary components of analytic functions. More 
specifically, it provides an expression for the behavior of the imaginary 
part at high frequencies, in terms of the integral of the real part, of a func- 
tion H that satisfies the following conditions: 

(i) H(jcu) = PM 4- jQM = H(— jtu), where P and Q are real-valued 
functions of tu; 

(ii) H(s) is analytic at s = oo and in the CRHP except possibly for singu- 
larities so = jtuo on the finite imaginary axis that satisfy lim s _, So (s — 
s 0 )H(s)=0. 
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Bode called the real and imaginary parts, P and Q, attenuation and phase, 
respectively, since he studied functions of the form H = log g, where g 
represented characteristics of an electrical network. This suggested the 
name of the theorem. 

Before presenting Bode's Attenuation Integral Theorem, we discuss a 
different interpretation of Theorem 2.3.3 in Chapter 2 that serves as mo- 
tivation. Recall that Theorem 2.3.3 1 gave an expression of the imaginary 
part of H at any frequency mo in terms of the integral of the complete 
frequency response of the real part of H. In the proof of Theorem 2.3.3, 
the function H was manipulated in order to create poles at s = jcuo and 
s = — jcuo in the integrand of (2.27). This led to the result that the inte- 
grand had residues of value jQ(cuo) at each of these poles, and thus the 
real-imaginary parts relation (2.26) can be alternatively interpreted as an 
expression for the residue at a finite frequency. There is no reason why the 
same procedure cannot be applied to evaluate the residue at infinity of H, 
denoted by Res s=00 H(s) (see §A.9.1 in Chapter A). This is the essential 
format of Bode's Attenuation Integral Theorem. 

Theorem 3.1.1 (Bode's Attenuation Integral Theorem). Let H be a func- 
tion satisfying conditions (i) and (ii). Then, for H(jcu) = P(co) + jQ(rn), 

J JlP(to) - P(oo)] dm = Res H(s) . (3.2) 

Proof. Since H is analytic at infinity, it follows from Example A.8.4 of Ap- 
pendix A that it has a Laurent series expansion of the form 

H(s) = • • • + + • • • H — + Co , (3.3) 

which is uniformly convergent in R < |s| < oo, for some R > 0. In view 
of the assumption (i) on H, it follows that the coefficients {ck} are real and 
that Co = P(cxj). 

Consider next the contour of integration shown in Figure 2.3 of Chap- 
ter 2, where the small indentations correspond to possible singularities of 
H on the imaginary axis, and where the large semicircle has radius larger 
than R. Denote this semicircle by Cr. Then, according to Cauchy's integral 
theorem 

|[H(s)-P(oo)]ds = 0. (3.4) 

The contribution of the integrals on the small indentations on the imag- 
inary axis can be shown (see the proof of Lemma A.6.2 in Appendix A) 
to tend to zero as the indentations vanish, due to the particular type of 



1 Theorem 2.3.3 was proven for proper and stable transfer functions, but the result also 
holds for any function H satisfying conditions (i) and (ii). 
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singularities characterized in (ii). The integral on the large semicircle of 
the terms in s k , k < 2, of (3.3) tends to zero as the radius becomes infinite 
(see Example A.4.1 in Appendix A). Hence, taking limits as R — » oo, (3.4) 
reduces to 

0 = | [P(co) + jQ(co) — P(oo)] jdcu T R lim J ds 

= 2} [ [P(cu] - P(oo)] dcu - j7TC_l , 

Jo 

where the second line is obtained using the symmetry properties of P and 
Q, and Example A.5.1 of Appendix A. Equation (3.2) then follows using 
Res s=00 H(s) = — c_i (see (A.80) in Appendix A). □ 

Note that, from (3.3), Q(cu) = ImH(jcu) = -c_i/co + cs/w 3 + ■■■. 
Hence (3.2) can also be written as 



[ [P(co) — P(oo)] dcu = — ^ lim cuQ(cu) 

JO 2 ID-KXJ 



This gives an expression for the behavior at infinity of the imaginary com- 
ponent of H. 

A formula parallel to (3.2) but applicable at zero frequency is easily ob- 
tained from the above result using the fact that H is analytic at zero. This 
is established in the following corollary. 

Corollary 3.1.2. Let H be a function such that H(1/£,) satisfies conditions 
(i) and (ii). Then 



f[PM - p (°)] ~J = T lim n • (3-5) 

J 0 cu z 2 s— >o ds 

Proof. Since H is analytic at zero it has a power series expansion of the 
form 

H(s) = do + ui s + • • • + a.kS k + • • • , (3-6) 

which is uniformly convergent in |s| < r, for some r > 0. Consider the 
function H(1 /£,), which is analytic at infinity and admits — from (3.6) — a 
Laurent series expansion of the form 



which is uniformly convergent in |£J > 1 /r. Then, using (3.2), we have 



J°°[P(1A)-P(0)]dv = ^a 1 



The proof is completed on making the change of variable of integration 
tu = 1/v and noting that ai = lim s _,o [dH(s)/ds]. O 
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The theorem and corollary given above, as well as Theorem 2.3.3 in 
Chapter 2, give examples of the great variety of formulae that can be 
obtained via a judicious choice of contour of integration and integrand 
in Cauchy's theorems. Bode collected a number of such formulae in his 
book; see, for example, the table at the end of Chapter 13 of Bode (1945). 
Our choice of the relations presented so far is justified by their immediate 
application in systems theory. Otherwise, to quote Bode, 

"... it is extremely difficult to organize all the possible relations 
in any very coherent way. In a purely mathematical sense most 
of the formulae are related to one another by such obvious 
transformations and changes of variable that there is no good 
reason for picking out any particular set as independent. Basi- 
cally they are merely reflections of Cauchy's theorem. Thus the 
expressions which one chooses to regard as distinctive must be 
selected for their physical meaning for the particular problem 
in hand." 



3.2.2 Bode Integrals for S and T 

This subsection starts this book's main journey through results concerning 
complementary mappings, by which we mean mappings relating signals of 
the loop and such that their sum is a constant mapping. We consider here 
the sensitivity function, S, and the complementary sensitivity function, 
T, of the classical unity feedback configuration of linear feedback control 
theory, represented in Figure 3.2. 



L(s) 



FIGURE 3.2. Feedback control system. 

These two mappings satisfy the complementarity constraint 

S(s) + T(s) = 1 . (3.7) 

This represents an algebraic trade-off (Freudenberg and Looze, 1985), since 
it constrains the properties of the closed-loop system at each frequency. 
It implies, for example, that the magnitudes of S and T cannot both be 
smaller than 1 /2 at the same frequency (Doyle et al., 1992). 

Assuming minimality, S has zeros at the unstable open-loop plant poles 
and T has zeros at the nonminimum phase open-loop plant zeros. These 
are generally known as interpolation constraints. More precisely, let the open- 
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loop system be L and assume that it is free of unstable hidden modes 2 . 
Then, the sensitivity and complementary sensitivity functions have the 
forms 

sw = ttW' and T(s) = TT^- (3 ' 8) 

The following lemma formalizes the interpolation constraints that S and 
T must satisfy at the CRHP poles and zeros of L. 

Lemma 3.1.3 (Interpolation Constraints). Assume that the open-loop sys- 
tem L is free of unstable hidden modes. Then S and T must satisfy the 
following conditions. 

(i) If p € C+ is a pole of L, then 

S(p)=0, and T(p) = 1. (3.9) 

(ii) If q e C+ is a zero of L, then 

S(q) = 1 , and T(q)=0. (3.10) 



Proof. Follows immediately from (3.8). □ 

This result states that the CRHP zeros of S and T are determined by 
those of L 1 and L. We introduce for convenience the following notation 
for the ORHP zeros of S and T. 3 



Z s ={seC + :S(s)=0}, 
Z T = {s e C+ : T(s) = 0} . 



(3.11) 



Lemma 3.1.3 then establishes the fact that Zs is the set of ORHP poles of L 
and Zt is the set of ORHP zeros of L. In other words, we have translated 
the open-loop characteristics of instability and "nonminimum phaseness" 
into properties that the functions S and T must satisfy in the CRHP. In par- 
ticular, note that if the open-loop system is formed by the cascade of the 
plant, G, and the controller, K, i.e., L = GK, then the constraints imposed 
by CRHP poles and zeros of G hold irrespective of the choice of K, provided 
that L has no unstable zero-pole cancelation. 

As a first extension of Bode's results to integrals on sensitivity functions, 
we will derive Horowitz's formula (3.1) and a complementary result for T 
using Theorem 3.1.1 and Corollary 3.1.2. 



2 Recall from Chapter 2 that L is free of unstable hidden modes if there are no cancela- 
tions of CRHP zeros and poles between the plant and controller whose cascade connection 
forms L. 

3 In the sequel, when defining a set of zeros of a transfer function, the zeros are repeated 
according to their multiplicities. 
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Example 3.1.1 (Horowitz's formula for S). Suppose that L is a proper ratio- 
nal function without poles in the ORHP. Assume that the closed-loop system 
is stable (i.e., the numerator of 1 + L is Hurwitz and L(oo) f — 1) and con- 
sider the corresponding sensitivity function S. It follows that Zs in (3.11) 
is empty and that the function H = log S satisfies assumptions (i) and (ii) 
of §3.1.1. Thus, we can apply Theorem 3.1.1 to the real part, log S(jcu)|, to 
obtain 

J [log |S(jcu)| — log|S(joo)|] dcu = Res logS(s) . 

If we further assume that the open-loop plant has relative degree two or 
more, then 4 Sfjoo) = 1 and Res s=(X) logS(s) = 0. This recovers Horowitz's 
area formula given in (3.1). o 



Example 3.1.2 (Horowitz's formula for T). Assume that L(s) is a minimum 
phase rational function such that L(0) ^ 0. Then, if we consider the comple- 
mentary sensitivity function T, we have that Zj in (3.11) is empty. Next, 
notice that the function T ( 1 /£,) can be written as 



THAI = 



l 

1 + 1/L(1/£.) ' 



(3.12) 



Then, under the assumption of closed-loop stability (which implies L(0) f 
— 1), the function H(1/£,) = log T( 1 /£,) satisfies conditions (i) and (ii) of 
§3.1.1. We thus obtain, from Corollary 3.1.2, 

j> I 1 " 1 ")' " '<* |T ' 0 '» S = IW) S ■ IT ■ 

If we further assume that L has at least two integrators then T(0) = 1 and 
lim s _>o dT(s)/ds = 0, which yields 

[ log |T(jcu)| ^ = 0 . 

Jo 00 



It is instructive at this point to reflect on the complementarity of these 
formulae for S and T, as well as the hypotheses required on the open-loop 
system L to derive them. Under appropriate conditions, S and T exhibit 
symmetry with respect to frequency inversion (Kwakernaak, 1995). For 
example, the condition that L be proper and L(joo) f —1 (or alternatively, 
that L be strictly proper) imply the analyticity of S and log S at infinity. On 
the other hand, the requirement that L(0) f {0, —1} (or that L has poles at 
zero) gives the analyticity of T and log T at zero. 



4 See Example A.9.2 in Appendix A. 
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The extensions to unstable open-loop plants and to plants with time de- 
lay were derived by Freudenberg and Looze 1985; 1987. The complemen- 
tary result for T was obtained by Middleton and Goodwin (1990). These 
two area formulae will be given next under the name of the Bode Integrals 
for S and T. We choose these names since the results are natural extensions 
of Bode's integral (3.2) to the sensitivity and complementary sensitivity 
functions. 



Theorem 3.1.4 (Bode Integral for S). Let S be the sensitivity function de- 
fined by (3.8). Let {pi : i = 1 , . . . , n p } be the set of poles in the ORHP of the 
open-loop system L. Then, assuming closed-loop stability, 

(i) if L is a proper rational function. 



log 



S(jcu) 

S(joo) 



s[S(s) — S(oo)] 
S(oo) 



+ 7r^p t : 



(3.13) 



(ii) ifL(s) =L 0 (s)e ST , where L 0 (s) is a strictly proper rational function 
and t > 0, 

[ log |S(jcu)| dcu = 7t V~pi . (3.14) 

J ^ 1=1 

Proof. Consider the contour of Figure 3.3, where the indentations Ci , C 2 , 
. . . , C Up into the right half plane avoid the branch cuts of log S corre- 
sponding to the zeros of S (see Figure A.19 in Appendix A). Let Co consist 
of the remaining portions of the imaginary axis and let Cr be the semicir- 
cle of radius R. 




Since log[S(s)/S(oo)] is analytic on and inside the total contour, denoted 
by C, then, by Cauchy's integral theorem. 
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Note that the computation of the portions of the integral on the imaginary 
axis and on the indentations is the same for both cases (i) and (ii) (the only 
distinction being that in (ii) we have that S(oo) =1). However, the integral 
on the large semicircle requires a different analysis in each case. 

The portion of the integral on Co gives 5 




For the integral on the branch cut indentations we have, using (A.85) of 
Appendix A, 



y J l°g^~y ds = -)27r^Repi = -j27t ^Tp t , 



where the last equality follows since complex zeros must appear in conju- 
gate pairs. 

It remains to compute the integral on Cr for each of the cases (i) and (ii). 



(i) If L is a proper rational function, the assumption of closed-loop sta- 
bility guarantees that the function logS(s) is analytic at infinity. We 
can then use Example A.9.2 of Appendix A to compute the integral 
on Cr in the limit when R — » oo as 



lim f log ds = }n Res log 

R->°°J Cr S(oo) s=oc ° S(oo) 



S(oo) 



lim s[S(oo) — S(s)] , 



where we have used (A.84) from Appendix A. 



(ii) If L = L 0 e ST , with x > 0 and L 0 strictly proper, we have that there 
is an r > 0 such that, for all s with Re s > 0 and |s| > r, the modulus 
of L(s) satisfies |L(s)| < 1. Then, a similar use of the expansion of 
log(l -i- s) as in Example A.9.2 of Appendix A yields 



logS(s) = — L 0 (s)e ST 



Lg(s)e 

2 



+ ••• , 



in {s : |s| > r and Re s > 0}. Since L 0 has relative degree at least one, 
then the above expansion has the form 



logS(s) = — e ST -I , 



in {s : |s| > r and Re s > 0} . 



5 Under the convention that the phase of a negative real number is equal to 71 for cu > 0 
and —7t for cu < 0. 
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Then, using the result in Example A.4.3 of Appendix A, we finally 
have that 

lim logS(s)ds=0. 

R ^°° Jc R 

The result then follows by combining the integrals over all portions of 
the total contour for each of the cases (i) and (ii). □ 



Theorem 3.1.4 shows that the presence of open-loop unstable poles fur- 
ther restricts the compromise between areas of sensitivity attenuation and 
amplification imposed by the integral. Specifically, since the term pt 
is nonnegative, the contribution to the integral of those frequencies where 
|S(jcu)| < 1 is clearly reduced if L has unstable poles. Moreover, the farther 
from the jcu-axis the poles are, the worse will be their effect. 

The first term on the RHS of (3.13) appears only if the plant has relative 
degree 0 or 1 and no time delay, and admits an interpretation in terms of 
the time response of L. Indeed, if l(t) denotes the response of the plant to 
a unitary step input, we can alternatively write 



s[S(s) — S(oo)] 



|"L(oo) — L(s)l 

. 1+Us) . 



t(0 + ) 

1 +L(oo) ’ 



where the last step follows from the Initial Value Theorem of the Laplace 
transform (e.g., Franklin et al., 1994). Thus, l(0 + ) is the initial slope of l(t), 
as illustrated in Figure 3.4. 




FIGURE 3.4. Step response of a plant of relative degree 0. 



If the plant has relative degree 0 or 1 , a large positive value for i (0 + ) will 
ameliorate the integral constraint for S. This, as we will see in more detail 
in §3.1.3, is justified by the fact that a larger value for 1(0+) is associated 
with larger bandwidth of the system. 
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If the plant has relative degree greater than 1, then t(0 + ) vanishes, and 
(3.13) reduces to (3.14). We will see in §3.1.3, however, that larger band- 
width still alleviates the trade-offs induced by this integral constraint. 

Naturally, an equivalent relation holds for the complementary sensitiv- 
ity function, as stated in the following theorem. 

Theorem 3.1.5 (Bode Integral for T). Let T be the complementary sensi- 
tivity function defined by (3.8). Let {q l : i = 1 , . . . , n q } be the set of zeros 
in the ORHP of the open-loop system L, and suppose that L(0) f 0. Then, 
assuming closed-loop stability, 

(i) if L is a proper rational function 



r°° , T(jco) do) 

J„ lo « w ^ 



n 1 dT(s) ^ 1 

2TioT!T»^ +n Lir ; 



(3.16) 



(ii) ifL(s) =Lo(s)e ST , where Lo(s) is a strictly proper rational function 
and t > 0, 



f 00 , T()U)) dcu 7t 1 dT(s) ^ 1 tt 

Jo 108 W ^-2T(0)&^T +7I 5^ + 2 t - ( ‘ } 



Proof. The proof follows along the same lines as that of Theorem 3.1.4 with 
inverted symmetry in the roles played by the points s = 0 and s = oo. The 
interested reader may find the details in Middleton (1991). □ 

It is interesting to note that the integral for T is in fact the same as that 
for S under frequency inversion. Indeed, by letting v = 1 /to, we can alter- 
natively express 



T(jtu) d co p 

T(0) w 2 Jo 



T(Vj-v) 

T(0) 



dv . 



Accordingly, as seen in (3.16) and (3.17), nonminimum phase zeros of L 
play for T an entirely equivalent role to that of unstable poles for S; i.e., 
they worsen the integral constraint. In this case, zeros in the ORHP that 
are closer to the j co-axis will pose a greater difficulty in shaping T. 

The first term on the RHSs of (3.16) and (3.17) has an interpretation in 
terms of steady-state properties of the plant. Consider the feedback loop 
shown in Figure 3.5. The Laplace transform of the error signal e = r — y is 
given by 



T(s)l i 
"W 



Hence, if r is a unitary ramp, i.e., R(s) = 1/s 2 , then the corresponding 
steady-state value of e(t) (see Figure 3.6) can be computed using the Final 
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FIGURE 3.5. Type-1 feedback system. 



Value Theorem (e.g., Franklin et al., 1994) and L'Hospital's rule (p. 260 
Widder, 1961, e.g., ) as 



e ss = lim e(t) 



T(s) 

T(0) 



Thus the constant l/T(0)dT/ds| s= o plays a role similar to that played by 
the reciprocal of the velocity constant in a Type-1 feedback system (e.g., 
Truxal, 1955, p. 286). Consequently, the corresponding term on the RHSs 
of (3.16) and (3.17) can ameliorate the severity of the design trade-off only 
if the steady-state error to a ramp input is large and positive, so that the 
output lags the reference input significantly. 




FIGURE 3.6. Steady-state error to ramp. 



Finally, the last term on the RHS of (3.17) shows that the trade-off also 
worsens if the plant has a time delay. In a sense this is not surprising, since 
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a time delay may be approximated by nonminimum phase zeros 6 , which 
already appear in connection with the Bode integral for T. 

In the following section we will discuss more detailed design implica- 
tions of the integral constraints given by Theorem 3.1.4 and Theorem 3.1.5. 



3.2.3 Design Interpretations 

As discussed in §3.1, the integral constraint (3.1) tells us that, if the feed- 
back loop is designed to hold |S(jcu)| smaller than one over a given fre- 
quency range, then it will be larger than one in another range. In the case 
of open-loop unstable plants, the constraint (3.14) shows that the trade-off 
is worsened since the integral must be positive in this case. 

Heuristically, this effect can be seen from the Nyquist plot of the open- 
loop transfer function, L, as follows. Consider first that L is a stable rational 
function of relative degree two or more; then L(jco) will ultimately have 
phase lag of at least — n. This situation is depicted on the left of Figure 3.7 
forL(s) = 1. 5/(1 +s) 2 . Note that S -1 (jtu) = 1 +L(jcu) is the vector from the 
— 1 point to the point on the Nyquist plot corresponding to the frequency 
cu. Thus, we see that there is a portion of the plot where |S(jco)| is less 
than one and another portion where |S(jo>)| increases above one. A similar 
situation occurs for strictly proper plants with time delay, as shown on 
the right of Figure 3.7 for L(s) = 1.5e 3s /(s + 2). In this case, however, 
the Nyquist plot alternates between areas of sensitivity attenuation and 
amplification infinitely many times. 




FIGURE 3.7. Graphical interpretation of the area formula. 



The possibility of achieving a negative value of the integral in (3.13) for 
stable open-loop systems having relative degree one can also be deduced 
from Figure 3.7. Indeed, these systems will exhibit an asymptotic phase 
lag of — 7t/2, and hence their Nyquist plot can be kept largely outside the 
region of sensitivity increase. 



6 This is evident in the Pade approximations of e ST (e.g., Middleton and Goodwin, 1990). 




60 



3. SISO Control 



Example 3.1.3. Let L = K/(s + 1 ), K > 0, i.e., a first order plant cascaded 
with a proportional controller. Then 



The value of the integral in (3.13) is — K (which is minus the initial slope 
of the step response of L). The Nyquist plot of L lies entirely in the forth 
quadrant, and therefore there is no area of sensitivity amplification. o 

Despite the area balance effect, one cannot immediately conclude from 
either (3.1) or (3.14) that a peak that is significantly greater than one will 
occur outside the frequency range over which sensitivity reduction has 
been achieved. Actually, it is possible that area of sensitivity reduction 
over some finite range of frequencies may be compensated by an area 
where |S| is allowed to be slightly greater than one over an arbitrarily large 
range of frequencies. 

Any practical design, however, is affected by bandwidth constraints. 
Indeed, several factors such as undermodeling, sensor noise, plant band- 
width, etc., lead to the desirability of decreasing the open-loop gain at high 
frequencies, thus putting a limit on the bandwidth of the closed loop. It is 
reasonable to assume, then, that the open-loop gain satisfies a design spec- 
ification of the type 

/ (Ur \ 1+lc 

|L(jcu)| < 6 (-^J , Vcu > cu c , (3.18) 

where 6 < 1 /2 and k > 0. Note that k, cu c and 6 can be adjusted to provide 
upper limits to the slope of magnitude roll-off, the frequency where roll- 
off starts and the gain at that frequency, respectively. 

By convention, the bandwidth of the closed-loop system in Figure 3.2 is 
defined (e.g., Franklin et al., 1994) as the frequency of a sinusoidal input, r, 
at which the output y is attenuated to a factor of 1 / \fl. From the definition 
of T in (3.8), the bandwidth cut, is the frequency at which |T(jcut, ) | = 1 /\fl. 
It is possible to approximate cut, by a factor (generally between 1 and 2) 
of the crossover frequency, cu 0 , defined as the lowest frequency at which the 
magnitude of the open-loop system is one, i.e., |L(jcuo)| = 1 (e.g., Franklin 
et al., 1994). Since cu c in (3.18) is such that |L(jcu c )| < 1/2, it follows that 
cu 0 < cu c and hence the bandwidth cu b can be roughly taken as cu b « cu c . 

The following result shows that a condition such as (3.18) on the open- 
loop gain puts an upper limit on the area of sensitivity increase that can 
be present at frequencies greater than cu c . 

Corollary 3.1.6. Suppose that L is a rational function of relative degree 
two or more and satisfying the bandwidth restriction (3.18). Then 

|J log IS(jcu)| dcu| < ■ 



(3.19) 
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Proof. We use the fact that if |s| < 1/2, then |log(l + s)| < 3|s|/2 (See 
Example A.8.6 in Appendix A). Then 



log |S(jtu)| dm| < J |log|S(jm)|| dm 
<J |log S(joa) | dm 

= J |log[l + L(jm)]| dcu 

36cu’+ k f 00 1 J 

< t — — TTk da) 

2 J a> c OJ 1+k 



36m c 

2k 



□ 

The above result shows that the area of the tail of the Bode sensitivity in- 
tegral over the infinite frequency range [cu c , oo) is limited. Hence, any area 
of sensitivity reduction must be compensated by a finite area of sensitiv- 
ity increase, which will necessarily lead to a large peak in the sensitivity 
frequency response before tu c . To see this, suppose that S is required to 
satisfy the following reduction condition 

|S(jcu)| < a < 1 , Vu> < cui < cu c . (3.20) 

Now, using (3.14) and the bounds (3.18) and (3.20), it is easy to show that 



sup log |S(jco)| 

>e(u>, ,o> c ) 



7T Y_ P + 

pez s 



l°g “ 



36m c 

2k 



(3.21) 

The bound (3.21) shows that any attempt to increase the area of sensitiv- 
ity reduction by requiring a to be small and/ or mi to be close to m c will 
necessarily result in a large sensitivity peak in the range (mi , tu c ). Hence, 
the Bode sensitivity integral (3.14) imposes a clear design trade-off when 
natural bandwidth constraints are assumed for the closed-loop system. 
Notice, however, that this trade-off is alleviated if the closed-loop band- 
width is large, i.e., large m c in (3.18). 



Example 3.1.4. The inequality (3.21) can be used to derive a lower bound 
on the closed-loop bandwidth in terms of the sum of open-loop unstable 
poles. Indeed, suppose that the frequency mi in (3.20) is taken to be a 
fraction of the bandwidth, say 



mi =ki 
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and assume that we desire that the peak sensitivity on the LHS of (3.21) 
be less than or equal to a number S m > 1. Then, necessarily, the lower 
bound on the RHS of (3.21) must be less than or equal to S m . Imposing 
this condition yields the following lower bound on the bandwidth, which 
we take as u)b = tu c , 

o) b > B(S m ) Y_ P - (3-22) 

P6Z.S 

where B(S m ) is 



(1 -lci)(S m -|-1.5 5/k + ki log a) ' 

The factor B(S m ) is plotted in Figure 3.8 as a function of the desired peak 
sensitivity S m , for 8 = 0.45, k = 1, ki =0.7 and a = 0.5. 




FIGURE 3.8. Lower bound on the bandwidth as a function of the peak sensitivity. 



We may conclude from this figure, for example, that an open-loop un- 
stable system having relative degree two requires a bandwidth of at least 
6.5 times the sum of its ORHP poles if it is desired that |S| be smaller 
than 1 /2 over 70% of the closed-loop bandwidth while keeping the lower 
bound on the peak sensitivity smaller than S m = \fl. o 



3.2 The Water-Bed Effect 

The Bode sensitivity and complementary sensitivity integrals represent 
a constraint imposed by nonminimum phase zeros and unstable poles 
of the open-loop system. We have just seen in §3.1.3 that these integral 
constraints, in conjunction with a further requirement on the closed-loop 
bandwidth, lead to a quantifiable trade-off in design. Indeed, from the 
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comment at the end of §3.1.3, we see that an arbitrary reduction of sensi- 
tivity over a range of frequencies necessarily implies an arbitrarily large 
increase at other frequencies. This kind of phenomenon has been referred 
to as a push-pop or water-bed effect (e.g., Shamma, 1991; Doyle et al., 1992). 

The water-bed effect was first recognized by Francis and Zames (1984), 
who showed that a similar trade-off exists with respect to sensitivity min- 
imization over a frequency interval when the open-loop system has a zero 
in the ORHP. This will be established below. As opposed to the previous 
results, which were based on the Cauchy integral theorem, the result that 
follows relies on an application of the maximum modulus principle (The- 
orem A. 10.2 in Appendix A). 

Theorem 3.2.1 (Water-Bed Effect). Let S be the sensitivity function de- 
fined by (3.8). Assume that S is proper and stable. Then, if the open-loop 
plant L has a zero in the ORHP, there exists a positive number m such that 

sup S(jco)| > 1/||S||™ , 

where 

||S||oo = sup |S(jtu)| 

is the infinity norm of S. 

Proof. Let q be a zero of L in the ORHP. It follows from (3.7) that S(q) = 1 . 
Consider the mapping from the CRHP onto the unit disk given by 

z= q ~ s s = q ~ qz 

Z q + s ’ S 1 +z 

Then the interval {s = jtu : co e [mi , 0 ) 2 ]} is mapped onto the arc 

{z = e ie :0e [0i, 0 2 ]}. (3.23) 



Let R be the following function. 



It follows that R is analytic in |z| < 1, R(0) — 1, and moreover 

sup |R(e i0 )|= sup |S(jtu)| , 
ee[0i,0 2 ] tue[coi,co 2 ] 



and 
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Now let 4> be the angle cj) = 02 — 0i and let n be any integer greater 
than 27t/4>. Define the auxiliary function P as 



P (z) -n4^ 



(3.24) 



Then P is also analytic in |z| < 1 , and P(0) = 1 . Since the angle 2n/u is less 
than 4), at least one of the points ze i27lk/n , k = 0, • • • , n — 1, lies on the 
arc (3.23) for each z on the unit circle. Thus, from (3.24) and the maximum 
modulus principle 

1 =|P(0)| 

<sup|P(e i0 )| 

0 

< [sup|R(e’ e )|] n 1 sup |R (e i0 ) | 

L e J 0e[0i,e 2 ] 

= IISII^T 1 sup |S(ju>)| . 

u>Clu>,.cu,| 

The result then follows by assigning m = n — 1 . □ 

This result shows the water-bed effect for linear nonminimum phase 
systems: the magnitude of S can be made arbitrarily small over a fre- 
quency interval only at the expense of having the magnitude arbitrarily 
large off this interval (Francis and Zames, 1984). We will next obtain al- 
ternative expressions for the sensitivity trade-offs using Poisson integral 
formula. In section §3.3.2, these results will be used to give a more explicit 
form for the water-bed trade-off. 



3.3 Poisson Integral Formulae 

Consider again the feedback control configuration of Figure 3.2 and the 
sensitivity and complementary sensitivity functions defined in (3.8). In 
§3.1.2 we discussed the algebraic trade-off imposed by the complementar- 
ity constraint (3.7), which, for example, precludes the possibility of having 
both small | S ( j w ) | and T(jcu) at the same frequency. We will see in this sec- 
tion that it is particularly revealing to evaluate this algebraic constraint at 
the nonminimum phase zeros and unstable poles of the open-loop trans- 
fer function L. Indeed, with the aid of the Poisson integral formula for the 
half plane (see §A.6.1 in Appendix A), we will show that this algebraic 
constraint actually leads to integral constraints on the overall frequency 
responses of S and T. 
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3.3.2 Poisson Integrals for S and T 

Before deriving the Poisson integral theorems for S and T, we need some 
preliminary notation. Recall that, if L is free of unstable hidden modes, 
the ORHP poles and zeros of L become zeros of S and T, as stated in 
Lemma 3.1.3. Let qt, i = 1 , . . . , n q , be the zeros of L in the ORHP, and 
Pi, i = 1 , . . . , Up, be the poles of L in the ORHP, all counted with mul- 
tiplicities. Following the notation introduced in (3.11), we then have that 
the ORHP zeros of S and T are given by 



Zs = {Pi:i = 1,...,n p }, 

Zr = {Qi : i = 1, . . . )TTq} . 



(3.25) 



We next introduce the Blaschke products of the ORHP zeros of S and T, 
given by (see also (2.37) in Chapter 2) 



T^Py^S 

r=i Pt + s 






(3.26) 



Blaschke products are "all-pass" functions, since their magnitude is con- 
stant and equal to one on the j co-axis. Using Bs and Bt, we factorize L 

jl(s)=L(s)B s 1 (s)B T (s)e ST , (3.27) 

where t > 0 is a possible time delay in the open-loop system, and where 
the factor L(s) is a proper rational function having no poles or zeros in the 
ORHP. Then S and T in (3.8) can be factored as 



S(s)=S(s)B s (s) , 

T(s) = T(s)B T (s)e~ ST . 



(3.28) 



Note that S and T have no zeros in the finite ORHP since the factors B$ 
and By remove the finite zeros of S and T. Also, if the closed-loop sys- 
tem is stable, both S and T have no poles in the finite CRHP. The point 
s = oo requires some more care. If t = 0 and L is proper, then both S and 
T are analytic at infinity. On the other hand, if t > 0 and L is proper, S 
and T have an essential singularity at infinity (see Example A.8.3 in Ap- 
pendix A). However, both functions log S and log T are of class 1R, i.e., their 
growth at infinity in the CRHP is restricted. 7 

The above discussion suggests that we can apply the Poisson integral 
formula — more specifically Corollary A.6.3 in Appendix A — to the func- 
tions log S and log T, as we show next. 



7 Recall that a function f is of class 3? if Hiur—^ R -1 sup 0e[7t/2 ,./i; :F Re' 1 ' ) = 0 
(§A.6.1 in Appendix A). Since L is proper and the closed-loop system is stable, it is not diffi- 
cult to see that S is bounded on the CRHP by a constant, S m say. Then log |S| < log S m on 
the CRHP and hence log |S|/R — > OasR — > oo.A similar argument shows that T is of class 
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Theorem 3.3.1 (Poisson Integral for S). Let S be the sensitivity function 
defined by (3.8). Assume that the open-loop system L can be factored as in 

(3.27) and let q = <j q + jcu q be an ORHP zero of L. Then, if the closed-loop 
system is stable, 

P log |S(jcu)[ P q _ 2 den = Ttlog |B S 1 (q)| . (3.29) 

J—oo °q IWq 

Proof. We will apply Corollary A.6.3 of Appendix A to the function log S. 
Since the closed-loop system is stable and in view of the factorization 

(3.28) , then S has no zeros or poles in the ORHP (see comments after (3.28)) 

and hence log S is analytic there. If x > 0 then log S has an essential sin- 
gularity at infinity, but these are allowed by Corollary A.6.3. Then, since 
log S is of class 01 (see footnote on page 65), (A.48) in Corollary A.6.3 can 
be used with with f = logS and so = q. The constraint (3.29) then fol- 
lows on noting that |S(jcu)| = |S(jcu)| (since |B s (jcu)| = 1, Vcu) and that 
S(q)=B s 1 (q) (since S(q) = 1). D 

The corresponding result for T is as follows. 

Theorem 3.3.2 (Poisson Integral for T). Let T be the complementary sen- 
sitivity function defined by (3.8). Assume that the open-loop system L can 
be factored as in (3.27) and let p = a p + jcu p be an ORHP pole of L. Then, 
if the closed-loop system is stable, 

| log IT(jtu)l g 2 + (^ P _ ^2 dm = Ttlog [By 1 (p)| +mr p T . (3.30) 

Proof. We will apply Corollary A.6.3 of Appendix A to the function log T. 
Since the closed-loop system is stable and in view of the factorization 

(3.28), T has no zeros or poles in the ORHP (see comments after (3.28)). 
If L is strictly proper, and/or if t > 0, then log T has a singularity at infin- 
ity, but these are allowed by Corollary A.6.3. Then, since log T is of class 01 
(see footnote on page 65), (A.48) in Corollary A.6.3 can be used with with 
f = logT and So = V- The constraint (3.29) then follows on noting that 
|T(ju>)| = |T(jco)| (since |B s (jcu)e-^| = 1, Vcu) and that T(p) = B^fo) 
(since T(p) = 1). □ 

Note that, as was the case for Corollary A.6.3 in Appendix A, Theorems 
3.3.1 and 3.3.2 still hold when L has poles or zeros on the imaginary axis. 
Also, if the ORHP zero q in Theorem 3.3.1 has multiplicity m > 1, addi- 
tional integral constraints on the first m — 1 derivatives of log S can be ob- 
tained. These, however, do not seem to be as insightful as (3.29). A similar 
comment is in order in the case of multiple ORHP poles in Theorem 3.3.2. 

Similar to the Bode integral formulae of §3.1.2, the Poisson integral con- 
straints (3.29) and (3.30) represent a balance between areas of sensitivity 
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or complementary sensitivity attenuation and amplification. To see this 
notice: first that, for So = do + jto 0 , cr o > 0, the weighting function 



w S0 M 



op 

0q + (tep - cn) 2 



(3.31) 



is positive for all to, and second that the RHSs of both equations are non- 
negative since, for a Blaschke product B, we have that B 1 (s)| > 1 for s 
in the ORHP. 

The area balance implied by the Poisson integrals, however, differs from 
that of the Bode integrals. Indeed, the presence of the weighting function 
(3.31) in the Poisson integrals precludes the possibility of compensating 
an area of sensitivity reduction over a finite range of frequencies by an 
area where |S| (or |T|) is allowed to be slightly greater than one over an 
arbitrarily large range of frequencies. This is because the weighted area of 
the imaginary axis is finite and equal to n, as seen from integrating (3.31). 
More insights into the properties of the weighting function will be given 
in the following section. 

The case where the open-loop system is both unstable and nonmini- 
mum phase is even more problematic. Indeed, note that both RHSs are 
positive if the open-loop system has at least one ORHP zero and one 
ORHP pole. If this is the case the weighted area of sensitivity increase 
must be larger than the area of sensitivity reduction. Moreover, since B j 1 (p ) 
in (3.29) has poles at p = qt, i = 1 , . . . , n q (similarly, B s 1 (q) in (3.30) has 
poles at q = pt, i = 1 , . . . , n p ), the constraints are aggravated if there is an 
approximate pole-zero cancelation in the ORHP. 

In the following section we will discuss design trade-offs implied by 
Theorems 3.3.1 and 3.3.2 with respect to sensitivity and complementary 
sensitivity minimization over a frequency interval. 



3.3.2 Design Interpretations 

In §3.1.3 we gave a graphical interpretation of the area balance implied by 
(3.1) using the Nyquist plot of the open-loop transfer function. It was seen 
in Figure 3.7 that, as long as the phase of the open-loop system surpasses 
— 7t, the plot must enter the area of sensitivity increase. It is well known 
that ORHP zeros introduce additional phase lag 8 to the open-loop system, 
which is evident from the fact that each factor of Bt in (3.26) satisfies 

arg qi -> -7i as cu -» oo. (3.32) 

5 9i + icu 



8 By additional phase lag introduced by an ORHP zero we mean the difference between 
the phase of the system with the ORHP zero and that of a system where the ORHP zero is 
replaced by its reflection in the OLHP. 
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Hence the trade-off between areas of sensitivity attenuation and amplifi- 
cation can also be observed in the Nyquist plot of a nonminimum phase 
open-loop system. As an example. Figure 3.9 shows the Nyquist plot of 
the function L(s) = (1 — s)/(1 + s) 2 together with its minimum phase 
counterpart L(s) = 1/(1 + s).It can be seen from this figure that the area 
balance is apparent for the nonminimum phase system whilst the Nyquist 
plot of the minimum phase system can be kept inside the area of sensitiv- 
ity reduction save, of course, at infinite frequency. 




FIGURE 3.9. Area balance for a nonminimum phase system. 



From the expression T = 1 /(I + 1 /L), it is evident that a similar graphic 
analysis can be done for the complementary sensitivity function by study- 
ing the Nyquist plot of 1 /L. Hence, the additional "phase lag" introduced 
by ORHP poles (of L) to the function 1 /L are now seen to be the cause of 
the need to balance the weighted areas where |T(jcu)| < 1 and |T( j cu ) | > 1 . 

The weighting function (3.31) — or Poisson kernel for the right half 
plane — in the integral constraints (3.29) and (3.30) takes explicit account 
of the effect of the additional phase lag introduced by ORHP zeros or 
poles. 9 To see this, given an interval [— o>i , o>i ], tui >0, consider the inte- 
gral of the weighting function (3.31), i.e.. 



>C,' 



J-cu, 00 + (u >0 - to) 2 

U)1 — O>0 0)1 + O»o 



(3.33) 



It is then easy to see that, for a real zero so = q = ciq, we have 



0q(cUl 



CTq - j(Ol 

arg— — : — , 
0q +)CU! 



9 Since the poles are here seen as zeros of 1 /L, we will use the word "zeros" in the discus- 
sion about the weighting function. 
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whereas for a pair of complex conjugate zeros so = q and q, we have 



(3.34) 



Note that 0 So (tui ) represents the weighted length (by the ORHP zero so) 
of the frequency interval [— o>i , cui]; thus, the weighted length of such an 
interval is equal to minus the additional phase lag introduced by the real 
ORHP zero (or to minus half the additional phase lag introduced by the 
pair of complex conjugate zeros) at the upper endpoint of the interval. 

The above interpretation of the weighted length of the frequency in- 
terval is useful in quantifying trade-offs implied by the Poisson integrals 
relative to the location of the ORHP zero. As an example, we will next re- 
visit the water-bed effect of §3.2. We view it here in the light of the integral 
constraint (3.29). 

Suppose, as in §3.1.3, that the feedback loop has been designed to achieve 
|S(jcu)| < < 1 , Vco efli = [— u)i,coi] . (3.35) 



Let q be an ORHP zero of L and consider the weighted length of the inter- 
val O], i.e., 0 q (coi ) as in (3.33). Then the infinity norm of the sensitivity 
function has a lower bound as shown in the following result. 

Corollary 3.3.3. Let S be the sensitivity function defined by (3.8) and sup- 
pose that the open-loop system L can be factored as in (3.27). Assume that 
the closed-loop system is stable and that the goal (3.35) has been achieved. 
Then, for each ORHP zero of L, q, we have 

e„(an) 

l|S|U> Bu!a ” B s 1 (q)| 71 , (3.36) 

where 0 q (cui ) is as in (3.33) with Sq = q. 



Proof. Dividing the range of integration in (3.29), and using the inequali- 
ties (3.35) and |S(jtu)| < IjSHoo, Vtu, we have 

log ai 0 q (coi ) + log || S||oo [n — 0 q (cui )] > 7tlog |Bg 1 (q)| . (3.37) 

The result then follows by exponentiating both sides. □ 

It is immediate from (3.36) that the lower bound on the sensitivity peak 
is strictly greater than one. Indeed, this follows from the fact that | B<r 1 ( q ) | > 
1, ai <1 and 0 q (o>i ) < n. Note also that if the open-loop system is both 
nonminimum phase and unstable, then the sensitivity peak is greater than 
one even if there is no region of sensitivity reduction. 
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Remark 3.3.1. Corollary 3.3.3 provides another interpretation for the water- 
bed effect of Theorem 3.2.1: if the open-loop system is nonminimum phase, 
then requiring |S(jcu)| to be small over a range of frequencies will neces- 
sarily lead to a large sensitivity peak outside that range. In this new form, 
however, the lower bound on the sensitivity peak exhibits an explicit de- 
pendence on the location of the ORHP zero of the open-loop system. In- 
deed, recall from our previous discussion that 0 q (cui ) is equal to minus 
the additional phase lag introduced by the real ORHP zero q (or to minus 
half the additional phase lag introduced by the pair of complex conjugate 
zeros q and q) at the frequency u> i . Thus, if at cu = cui the ORHP zero 
contributes with a significant amount of lag (0 q (cui ) close to n, say) the 
first term on the LHS of (3.37) will be large (and negative) and hence will 
require a large value of ysHoo to satisfy the lower bound on the RHS. On 
the other hand, if the lag introduced by the zero at cui is small then the 
trade-off implied by (3.36) will not be severe. 

Observe that, since |S(jco)| < ai < 1 implies |L(jcu)| > 1/ai — 1, a de- 
sirable feedback design objective would be to roll-off the open-loop gain 
well before the phase lag introduced by the ORHP zero becomes signifi- 
cant. This confirms a well-known rule of thumb used in classical feedback 
control design. o 

A result parallel to Corollary 3.3.3 for the complementary sensitivity 
function can be easily obtained if we assume that the following goal has 
been achieved (e.g., for robustness purposes) 

|T(jco)| < a .2 < 1 , Vcu e 02 — [— oo,— m 2 ] U [ 102 , 00 ] . (3.38) 

We then have the following result. 

Corollary 3.3.4. Let T be the sensitivity function defined by (3.8) and sup- 
pose that the open-loop system L can be factored as in (3.27). Assume that 
the closed-loop system is stable and that the goal (3.38) has been achieved. 
Then, for each ORHP pole of L, p, we have 

||T|U>(^) 0P(CU2) , (3.39) 

where 0 P (cui ) is as in (3.33) with so = p. 

Proof. Similar to the proof of Corollary 3.3.3, using the bound (3.38). □ 

Notice that, according to the definition of closed-loop bandwidth in 
§3.1.3, m 2 in (3.38) is equal to the bandwidth a>b if 0 C 2 is taken to be 1 /\fl. 
In view of this observation. Corollary 3.3.4 can be used to obtain bounds 
on the closed-loop bandwidth, as shown in the following example. 

Example 3.3.1. Consider the feedback system of Figure 3.2, and assume, 
for simplicity, that the open-loop system L has a real ORHP pole p = <r p . 
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is minimum phase and has no time delay, i.e., q = 0 and t = 0 in (3.27). 
Assume that the closed-loop system is stable and satisfies (3.38) for ot 2 = 
\/\fl (and hence m 2 = tu b ). Then 



IITIloo > sfl 



Suppose further that we impose the condition that the RHS of the above 
expression be less than or equal to T m , which is necessary if we require that 
the peak complementary sensitivity (i.e., the LHS of the above expression) 
be less than or equal to T m . Using this additional requirement we obtain 
the following lower bound on the closed-loop bandwidth 



cut, > p tan ( — — | . (3.40) 

^2 + 21ogT m /log V2J 

We conclude from (3.40), for example, that an open-loop system having a 
real ORHP pole, p, requires a bandwidth at least equal to p if it is desired 
to keep the lower bound on the peak complementary sensitivity smaller 
than T m = s/2. 

Notice that the lower bounds on the bandwidth given by (3.22) and 
(3.40) are not directly comparable, since (3.22) was obtained from require- 
ments on S while (3.40) follows from specifications on T. o 

A more realistic design will require both (3.35) and (3.38) to be satisfied. 
Note that (3.38) implies |S(jcu)| < 1 + 0 C 2 , Vco e Q-i- Figure 3.10 represents 
the combined shape specifications on |S(jcu)|. 





1 d 
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4 
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FIGURE 3.10. Frequency specifications for S. 
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Using this additional information as in the proof of Corollary 3.3.3 we 
obtain 



/ 1 \ 0q ( 0L>2 ) — < 

IISIloo > - 



try 



(3.41) 



< |B s '(q)| 



The following example examines the severity of constraint (3.41). 
Example 3.3.2. Suppose that we desire to control a plant with a single 
nonminimum phase zero q > 0. We assume for simplicity that the plant 
is open-loop stable. We desire for the closed-loop system a sensitivity re- 
duction of at least ai within the interval of frequencies [0, mi], where tui 
is chosen to be three quarters of the desired closed-loop bandwidth fre- 
quency u)b, i.e., the specification (3.35) holds with tui = 0.75a>b- 
Following the definition of closed-loop bandwidth on page 60, we can 
write the requirement of bandwidth by setting m 2 = tub and 0L2 — l/\/2 
in (3.38) (see also Example 3.3.1). 

Figure 3.11 plots the lower bound (3.41) on ||S|^ versus the position of 
the nonminimum phase zero (relative to the desired bandwidth), and for 
different values of sensitivity reduction. 




FIGURE 3.11. Lower bound (3.41) on ||S||< 



As anticipated in Remark 3.3.1, the picture shows that the constraints 
imposed by a nonminimum phase zero worsen the more the zero is within 
the desired closed-loop bandwidth, which manifests as higher peaks in 
|S(ju>)|. Since, as seen in Chapter 2, large peaks in |S(ju>)| are associated 
with poor sensitivity and robustness properties, then a nonminimum phase 
zero imposes a trade-off in design that limits the achievable closed-loop 
bandwidth of the system. The same conclusion holds for complex non- 
minimum phase zeros. o 
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Notice that the bound (3.41) is satisfied with equality for an "ideal" sen- 
sitivity function that is sectionally constant and equal to ai in Cl i , to 1 1 S 1 1 <*, 
in [— 0 ) 2 , — cui] U [a>i , 0 * 2 ], and to 1 + 0 C 2 in Cl 2 . Hence, the lower bound 
given by (3.41) is in fact conservative. The closer the actual sensitivity is to 
the "ideal" function, the tighter the bound (3.41) is. 10 Although, in theory, 
this sectionally constant function can be arbitrarily approximated by a ra- 
tional function, there exist a number of practical limitations in achieving 
this result. For example, a restriction on the complexity of the controller 
would mean that the ideal case cannot be achieved. 

Finally, if the plant has more than one ORHP zero, bounds similar to 
(3.36) or (3.41) hold for each of them, which, in general, will provide dif- 
ferent information. Thus, since each of these bounds may not be tight if 
considered alone, it will be necessary to analyze them in combination to 
obtain the overall trade-offs imposed by the set of ORHP zeros. However, 
this will not be as insightful and simple as in the case of a single zero, 
which shows a limitation of the approach. A different technique, based 
on Nevanlinna-Pick theory, has been described by O'Young and Francis 
(1985). This technique provides an iterative procedure to compute "hard" 
bounds on the sensitivity function for multivariable plants with several 
ORHP zeros. 

3.3.3 Example: Inverted Pendulum 

Consider again the inverted pendulum shown in Figure 3.12, studied in 
§1.3.3 of Chapter 1 in the time domain. 




FIGURE 3.12. Inverted pendulum. 



It was seen in §1.3.3 that the linearized model for this system has a trans- 
fer function from u to y of the form 



Y(s) _ (s — q)(s + q) 
U(s) Ms 2 (s — p)(s +p)’ 



10 Less conservative bounds can be also derived from these integral constraints by consid- 
ering more realistic shape specifications; see for example Middleton (1991) or Middleton and 
Goodwin (1990, Chapter 13). 
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i.e., it has one nonminimum phase zero and one unstable pole. Assume 
that the parameters in the model are chosen as in §1.3.3, i.e., so that the 
ORHP zero is q = 1 and the pole is moved according to four different 
values of the mass ratio m/M. For example, for m/M = 1, the pole is 
p = V2. Using Corollary 3.3.3 and Corollary 3.3.4 with the latter values 
of p and q, and assuming no particular range of sensitivity reduction (i.e., 
taking a>i = 0 in (3.35) and o >2 = oo in (3.38)), then the peak sensitivity 
and complementary sensitivity satisfy 

IISIloo >5.8284, and |ff^ > 5.8284. (3.42) 

Figure 3.13 shows log |S(jcu)| and log |T(jtu)| achieved by the same LQG- 
LQR design used in §1.3.3, for m/M = 0.1 , 0.2, 0.4, 1 . These figures corre- 




FIGURE 3.13. log |S(jtu)| and log |T (jtu) for the inverted pendulum. 



spond to the output time response plotted in Figure 1.5 of Chapter 1. Note 
that the actual peaks are much larger than predicted, which is due to the 
fact that the bounds (3.42) assume |S| and |T| flat and equal to their infinity 
norms. Tighter bounds can be obtained by assuming that |S| has a section- 
ally constant shape as in (3.41), or using more sophisticated shapes as in 
Middleton (1991). Note, however, that the bounds derived in this chapter 
are valid for any design methodology, and hence it is expected that they 
will be conservative for some particular design choices. 



3.4 Discrete Systems 

This section describes the extension of the Poisson and Bode integral re- 
lations to discrete-time feedback control systems. We again focus on sen- 
sitivity and complementary sensitivity functions of feedback control sys- 
tems, but the transfer functions are here complex functions of the variable 
z, i.e., they represent the 2,-transform of impulse responses of discrete-time 
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systems. We will see that the continuous-time results extend in a straight- 
forward fashion to discrete time by means of the Poisson integral formula 
for the unit disk, treated in §A.6.2 of Appendix A. We will also see, how- 
ever, that in general, the discrete constraints are more demanding since 
the sensitivity trade-offs must be achieved on the finite frequency interval 
[0,7t]. 

The results in this section apply to systems (plant and controller) whose 
original description is in discrete time; if the original description of the 
plant is in continuous time and the controller is digital, we call the over- 
all system a sampled-data system, and the analysis is more adequately per- 
formed in continuous time. Sampled-data control systems are discussed 
in Chapter 6. 



3.4.1 Poisson Integrals for S and T 

Consider the feedback control loop of Figure 3.14, where the open-loop 
system, L, is a proper transfer function of the complex variable z. 



L(z) 





FIGURE 3.14. Discrete-time feedback control system. 



As in (3.8), the sensitivity and complementary sensitivity functions of 
the loop in Figure 3.14 are defined as 



S(z) 



1 

1+L(z) 



1 + L(z) ’ 



(3.43) 



respectively. In common with the continuous-time case, the sensitivity and 
complementary sensitivity functions for the discrete case satisfy interpo- 
lations constraints imposed by zeros and poles of the open-loop system. 

Indeed, if L is free of unstable pole-zero cancelations, 11 then S has zeros 
at the unstable open-loop plant poles and T has zeros at the nonminimum 
phase open-loop plant zeros; i.e.. Lemma 3.1.3 holds with C+ replaced by 
the region outside the open unit disk, which we denote by ID C . 



11 Recall from Chapter 2 that, for discrete-time systems, a transfer function is nonminimum 
phase if it has zeros outside the open unit disk, D, and it is unstable if it has poles outside 
D. Thus, L is free of unstable pole-zero cancelations if there are no cancelations of zeros and 
poles outside D between the plant and controller whose cascade connection form L. 
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For the purpose of deriving Poisson integral constraints, we need to 
extract from S and T all the zeros outside the closed 12 unit disk — denoted 
by D . Let qt, i = 1 , . . . , n q , be the zeros of L in D , and p^, i = 1 , . . . , n p , 
be the poles of L in 3> , all counted with multiplicities. It follows from our 
previous discussion that the qt's are the zeros of T in ID , and the pi's are 
the zeros of S in D . We introduce the discrete Blaschke products of the zeros 
of S and T, given by 



= T-T_Pi_ Z-Pi 

IPil 1 ~PTz ’ 



< 3 «> 



We will define B$(z) = 1 if L is stable, and B T (z) — 1 if L is minimum 
phase. Similar to their continuous-time counterpart, the discrete Blaschke 
products are "all-pass" functions, since their magnitude is constant and 
equal to one on the unit circle |z| = 1. Using (3.44), and extracting the 
zeros at infinity in a similar fashion as was done in (2.7) in Chapter 2, we 
can factor the open-loop transfer function, L, as 

L(z) = Bg 1 (z) B t (z) L(z) z~ 6 , (3.45) 

where L is a stable, minimum-phase transfer function, having relative de- 
gree zero. It is then easy to see that S and T in (3.43) can be factored as 



S(z)=S(z)B s (z) , 
T(z) = T(z)B t (z)z -6 , 



(3.46) 



where S and T have no zeros in the region outside the closed unit disk (in- 
cluding infinity). Note that here the zeros at infinity of T (which are branch 
points of logT, see §A.9.2 in Appendix A) have to be factored explicitly 
since they will contribute to the value of the Poisson integral of log T on 
the unit circle. This is because the point at infinity is an interior point of 
the region "encircled" by the unit circle, ET", and thus it should be treated 
as any other finite singularity of log T in B . Note that this is not the case 
for continuous-time systems, i.e., the singularities at infinity of log T aris- 
ing from a strictly proper L do not add to the value of the Poisson integral 
of log T on the imaginary axis (see Corollary A.6.3 in Appendix A, and the 
proof of Theorem 3.3.2). 

Assuming stability of the closed-loop system, and since, as just seen, S 
and T in (3.46) have no zeros in D 0 , then the functions log S and log T are 
analytic in if. The real parts of these functions are harmonic in B c , and 



12 Recall that, in the continuous-time case, only the zeros and poles of the plant in the 
ORHP impose integral constraints. Those on the imaginary axis do not contribute to the 
value of the integrals (see Lemma A.6.2 and Corollary A.6.3 in Appendix A). 
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they thus satisfy the conditions of Corollary A.6.5 in Appendix A. We then 
obtain the following results. 

Theorem 3.4.1 (Poisson Integral for S). Let S be the discrete sensitivity 
function defined by (3.43). Assume that the open-loop system L can be 
factored as in (3.45) and let q = r q e i011 be a zero of L in if . Then, if the 
closed-loop system is stable, 

£log|S(e>»H { ^ £ ~ g<) + Tj « - M-g |B? 'Ml ■ (3-47) 

Proof. Under the assumptions of the theorem, S can be factored as in (3.46), 
where S is a stable, minimum-phase transfer function, having relative de- 
gree zero. It follows that the function log |S| is harmonic in B . Using 
Corollary A.6.5 in Appendix A with u = log |S| and So = q, and noting 
that |S(e’ e )| = |S(e i0 )| (since |B s (e’ e )| = 1, V0) and that S(q) = B^(q) 
(since S ( q ) = 1 ), yields the desired result. □ 

The corresponding result for T is as follows. 

Theorem 3.4.2 (Poisson Integral for T). Let T be the complementary sen- 
sitivity function defined by (3.43). Assume that the open-loop system L 
can be factored as in (3.45) and let p = r p e i0p be a pole of L in B c . Then, if 
the closed-loop system is stable, 

J^log|T(d 0 )l 1 _ 2r ^ c ^^ )+r2 de = 27tlog (Bt 1 (p)| +27t61og!p| . 

(3.48) 

Proof. The proof uses Corollary A.6.5 in Appendix A with u = log |T|, 
where T is given in (3.46), and so = p. Then (3.48) follows by similar argu- 
ments to those used in the proof of Theorem 3.4.1. □ 

As in the continuous-time case, two technical comments are in order. 
We first note that Theorems 3.4.1 and 3.4.2 still hold when L has poles 
or zeros on the unit circle. Second, if the zeros and/or poles of L outside 
the unit disk have multiplicities greater than one, then additional integral 
constraints on the derivatives of log S and of log T can be derived. 

Also similar to the Poisson integral constraints for continuous-time sys- 
tems, the relations (3.47) and (3.48) represent a balance between weighted 
areas of sensitivity or complementary sensitivity attenuation and ampli- 
fication. This is because: (i) for zo = roe’ 00 with ro > 1, the weighting 
function (or Poisson kernel for the unit disk) 




1 — 2r 0 cos(9 - 9o ) +r^ 



W Z0 (0) 



(3.49) 
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is positive for all 0, and (ii) the RHSs of both equations are nonnegative 
since, for a discrete Blaschke product B, we have that |B _1 (z)| > 1 for 
|z| > 1 . These facts imply that the weighted area of sensitivity increase 
must be, at least, as large as the weighted area of sensitivity reduction. 
This situation is aggravated if the open-loop system is both unstable and 
nonminimum phase, since in this case both |Bg 1 (q) | and [B^ 1 (p) | on the 
RHSs of (3.47) and (3.48) are strictly greater than one. Moreover, the closer 
the unstable zeros and poles are to each other, the larger the RHSs of both 
equations become. 

Note also the similarities between Theorem 3.4.2 and its counterpart for 
continuous-time systems. Theorem 3.3.2. In particular, the term due to the 
relative degree of the plant in the discrete case in (3.48) is analogous to 
that due to a pure time delay in (3.30). Hence, the constraints imposed 
on T by open loop time delays and unstable poles are also present in the 
discrete case, and again, the "more unstable" the pole, and the larger the 
time delay, the worse these constraints will be. 

In the following section we will discuss some of the design trade-offs 
implied by Theorems 3.4.1 and 3.4.2. 



3.4.2 Design Interpretations 

The Poisson integrals of Theorem 3.4.1 and Theorem 3.4.2 can be used 
to derive lower bounds on the infinity norms of the discrete sensitivity 
functions. As in the continuous-time case, these lower bounds exhibit the 
water-bed effect experienced by nonminimum phase plants when sensi- 
tivity reduction is required over some frequency range. 

To analyze the water-bed effect, we require the weighted length of an 
interval on the unit disk by the kernel (3.49) (cf. the corresponding for the 
weighting function for the half plane, given by (3.33)), i.e.. 



j-6i 



(0)d9 
T 0 + 1 f 



(3.50) 



where the interval of interest is 0i = [— 0i , 0i], 0i < n. It is possible to 
show that 0 Zo (0i ) is equal to minus half the sum of the phases of the dis- 
crete Blaschke products corresponding to zo and its conjugate, evaluated 
at z = e )01 , i.e.. 



0*0 (01 ) = -^ ar g— r _ ]9 , + arg — 

2 ° rn 1 -Zne’ 9 ' ° Tn 



r 0 1 -z o e’ 0; 
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This was also the case for the weighted length of an interval on the imagi- 
nary axis by the Poisson kernel for the right half plane, as can be seen from 
equation (3.34). 

Suppose next that the discrete feedback control loop has been designed 
to achieve the goal 

|S(e j0 )| < a< 1 , VBe©! =[-01,01], 0i<7t. (3.51) 

Let q be a zero of L in D and consider the weighted length of the inter- 
val 0i, i.e., 0 q (0i ) as in (3.50). Then the infinity norm of the sensitivity 
function has a lower bound as shown in the following result. 

Corollary 3.4.3. Let S be the sensitivity function defined by (3.43) and sup- 
pose that the open-loop system L can be factored as in (3.45). Assume that 
the closed-loop system is stable and that the goal (3.51) has been achieved. 
Then, for each zero of L in if , q — r q e ie ", 

e q (e,) 

l|S|U> (Tp @1,(ei] |B s 1 (q)|-e"(eL , (3.52) 

where 0 q is the function defined in (3.50). 

Proof. The proof follows that of Corollary 3.3.3. □ 

Similar comments to those following Corollary 3.3.3 are also relevant 
here. In particular, we note that the lower bound on the RHS of (3.52) is 
strictly greater than one and it becomes larger when the open-loop system 
has both zeros and poles in D . Also, parallel lower bounds can be derived 
for the complementary sensitivity function, as well as bounds arising from 
combined specifications for S and T. The interested reader is encouraged 
to restate the results in §3.3.2 for the discrete-time case. 

3.4.3 Bode Integrals for S and T 

In this section we obtain Bode integral constraints for the discrete-time 
sensitivity and complementary sensitivity functions. Recall that, in Theo- 
rems 3.1.4 and 3.1.5, we established the corresponding results for continuous- 
time systems by direct contour integration. We will not follow the same 
procedure here, but instead we will derive the Bode integrals from the 
Poisson integral formula for the disk. This is done in the following results. 



Theorem 3.4.4 (Bode Integral for S). Let S be the sensitivity function de- 
fined by (3.43). Assume that the open-loop system, L, is strictly proper 
and let {pi : i = 1 , . . . , n p } be the set of poles of L in D . Then, assuming 
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closed-loop stability. 



log|S(e j0 )| d0 = TT^loglpd . 



(3.53) 



Proof. As in the proof of Theorem 3.4.1, we use the factorization (3.46) and 
apply Corollary A.6.5 in Appendix A with u = log |S| and So = r, r > 1. 
This yields 

T J log |S(e<» )| 1 - 2 ; 2 e ~ l - r2 d6 = log |5(r)| 

= log | Bi" 1 (r ) | +log|S(r)| . (3.54) 

Next, we take limits as r — > oo on both sides of (3.54). Using the uniform 
convergence theorem to take limits inside the integral (Levinson and Red- 
heffer, 1970, p. 335), and the fact that |S(e ^ )| = S(e j0 )|, we have that the 
LHS in (3.54) tends to 

iJ"log|S(e’ e )|d0. 

As for the RHS, note that lim MOO log |S(r)| = 0, since L is strictly proper, 
and 

lim loglBg^r)! = lim logJ^[|- — I 

MOO i=1 | T — Pi | 

= ^loglptl . 

The result (3.53) then follows. □ 

The parallel result for T is given in the following theorem. 

Theorem 3.4.5 (Bode Integral for T). Let T be the complementary sensi- 
tivity function defined by (3.43). Assume that the open-loop system L can 
be factored as in (3.45) and let {qt : i = 1 , . . . , n q }be the set of zeros of L in 
B . Suppose further that L(1 ) f 0. Then, assuming closed-loop stability. 



r. T(e- j0 ) d9 7t dT(z) , |qd 2 - 

Jo ° g T(1) 1 — cos 0 T(l) mi dz +7T ^|qi-1 



■ +7T6 , 

(3.55) 



where 6 is the relative degree of L. 

Proof. From the factorization (3.46), we write the Poisson Integral formula 
(Corollary A.6.5) for log(T/T(1 )) evaluated at a real point r > 1 (note that 
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T(1 ) / 0 since L(1 ) / 0 by assumption). This gives 



log 



T(e j0 ) r 2 — 1 

T(1 ) 1 -2rcos(9) +r 2 



de = n 1 og|IM| 

+ 7t log B, ' (r)J -F nb log r . (3.56) 



Next, we divide both sides of (3.56) by (r — 1 ) and take limits as r — t 1 . We 
compute each term in turn. First, by the uniform convergence theorem, 
the limit on the LHS of (3.56) can be brought inside the integral, and then, 
using the fact that |T(e i0 )| = |T(e’ 0 )|, it is easy to check that the LHS of 
(3.55) is obtained. 

Then consider the first term on the RHS of (3.56). We have 



->i (r - 1 



HIM 



^(vby'^Tfry) 



, dT(z) 



" T(1) z 



(3.57) 

(3.58) 



which follows by applying L'Hospital's rule. This is the first term on the 
RHS of (3.55). The second term on the RHS of (3.55) is also obtained from 
a straightforward application of L'Hospital's rule to the following limit 



51 (dTT los|B?,(T)| = !5l2(vnT 



(1 — rq t ) (1 -rqQ 
(r- qO(r- q t ) 



Finally, the proof is concluded by noting that 



7t5 logr 



□ 

We see in (3.55) that Theorem 3.4.5 is entirely analogous to its continuous- 
time counterpart. Theorem 3.1.5. Indeed, the first term on the RHS of (3.55) 
is precisely minus the reciprocal of the velocity constant of a discrete-time 
system equivalent to that in Figure 3.5. The effect of nonminimum phase 
zeros of L is also equivalent to that in continuous-time, and so is the effect 
of the relative degree of L, which corresponds to a time delay of 8 discrete 
units. Hence, the same interpretations that were given for Theorem 3.1.5 
apply to Theorem 3.4.5 for discrete-time systems. 

Nevertheless, an important difference between these integrals in the 
continuous- and discrete-time cases is that the latter involves restrictions 
over a finite interval. We see this in more detail in the following subsection, 
where we study the design trade-offs induced by Bode's discrete sensitiv- 
ity integral. 
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3.4.4 Design Interpretations 

Bode integral formulae, both in the discrete and continuous-time case, in- 
dicate that there is a balance of areas of sensitivity reduction and increase. 
In the continuous-time case, however, the Bode integral formula does not 
imply a direct trade-off in design if additional bandwidth constraints are 
not imposed (see §3.1.3). Indeed, since integration is performed over an in- 
finite range, the area of sensitivity reduction over a finite range of frequen- 
cies may be compensated by an area where |S| is allowed to be slightly 
greater than one over an arbitrarily large range of frequencies. 

On the other hand, in the discrete-time case, the Bode integral implies 
a nontrivial sensitivity trade-off even if no bandwidth constraint is as- 
sumed. This is seen from the following immediate corollary. 

Corollary 3.4.6. Suppose that the conditions of Theorem 3.4.4 hold. As- 
sume further that the goal (3.51) has been achieved. Then necessarily 



lisiu > 01 |fl Pi | 91 • < 3 - 59 ) 

Proof. The proof follows by splitting the range of integration in (3.53) and 
using the bounds (3.51) and |S(e j0 )| < HSH^, V0. O 



Similar results can be derived from Theorem 3.4.5 for the discrete com- 
plementary sensitivity function, showing that discrete nonminimum phase 
zeros and time delays induce design trade-offs even if no bandwidth con- 
straints are imposed on the discrete system. 

However, the above conclusions might be irrelevant to the real design 
problem if the discrete system corresponds to the discretization of a continuous- 
time system where the controller is implemented digitally. This is dis- 
cussed in the following remark. 

Remark 3.4.1. Consider the discrete system shown in Figure 3.15. In this 
system, K d is a digital controller and (GH) d denotes the discrete equiv- 
alent of the cascade of a hold, H, and a continuous-time plant, G. This 
discretized plant is depicted in Figure 3.16, and usually arises in the analy- 
sis and design of continuous-time systems where the controller is imple- 
mented digitally. 13 

The signals in Figures 3.15 and 3.16 represent discrete-time signals, where 
{Uk} is the discrete output of the digital controller, and {r k }, {rjk} are the 
sampled values of the continuous-time reference and output signals, re- 
spectively. 



13 We give a more thorough treatment of these systems in Chapter 6, to which we refer for 
further details. 
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FIGURE 3.15. Discrete-time representation of a sampled-data control system. 



If we define L as the product of discrete controller and discretized plant, 
L = (GH) d K d , then the system may be studied by analyzing the corre- 
sponding discrete sensitivity and complementary sensitivity functions S 
and T defined in (3.43). The model of the system obtained by discretiza- 
tion is LTI, due to the periodicity of the sampling process, which greatly 
simplifies the analysis. However, a limitation of this method is that such 
models fail to represent the full response of the system, since intersample 
behavior is inherently lost or hidden. 14 



FIGURE 3.16. Discrete equivalent of the cascade of hold and plant. 



It is well known that the poles of the discretized plant are determined 
by those of the continuous-time plant via the mapping z = e ST , where t 
is the sampling period (e.g., Middleton and Goodwin, 1990). The discrete 
zeros of (GH) d , however, bear no simple relation to those of G and, in 
fact, may be arbitrarily assigned by suitable choice of the hold device (Astrom 
and Wittenmark, 1990, p. 74). 

From this observation, it may be tempting to conclude that design lim- 
itations due to nonminimum phase zeros of the analogue plant may be 
circumvented by assigning the zeros of the discretized plant to be mini- 
mum phase. 

Unfortunately, as we will see in Chapter 6, the difficulties imposed by 
nonminimum phase zeros of the analogue plant remain when the con- 
troller is implemented digitally and, moreover, are independent of the 
type of hold used. It is important that the intersample behavior be ex- 
amined if the problems are to be detected, since analyzing the system re- 
sponse only at the sampling instants may be misleading. o 



14 Some intersample information can still be handled in a discrete model by using the mod- 
ified Z-transform. However, this line of work will not be pursued here. 
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3.5 Summary 

In this chapter, we have considered both continuous and discrete-time 
scalar systems in unity feedback control loops. For these systems, we have 
presented integral relations on the frequency response of the sensitivity 
and complementary sensitivity functions. These integrals — of the Bode 
and Poisson type — follow from applications of Cauchy's integral rela- 
tions, and reveal constraints on the closed-loop system imposed by ORHP 
open-loop poles and zeros. One can use these constraints to study funda- 
mental limitations on the achievable performance of the closed loop. For 
example, it is possible to show that, if the open-loop system is nonmini- 
mum phase, then requiring |S(jtu)| to be small over a range of frequencies 
will necessarily lead to a large sensitivity peak outside that range. More- 
over, the relations allow one to quantify this peak in terms of parameters 
of the open-loop plant. Thus, it is possible to use the results presented 
here to establish bounds on the achievable frequency responses for S and 
T, which hold for all possible controller designs. 



Notes and References 

Bode Integral Formulae 

§3.1.1 is taken mainly from Bode (1945); §3.1.2 is based on results of Horowitz 
(1963), Freudenberg and Looze 1985; 1987, Middleton and Goodwin (1990) and 
Middleton (1991). §3.1.3 follows Freudenberg and Looze (1988), but it is also pos- 
sible to obtain similar results assuming functional bounds, as was done in Middle- 
ton (1991). 



The Water-Bed Effect 

This result was first discussed by Francis and Zames (1984), and then revisited by 
Freudenberg and Looze 1987 and Doyle et al. (1992). The result presented here is 
the one given in Francis and Zames (1984). 

Poisson Integral Formulae 

This section is largely taken from Freudenberg and Looze 1985; 1988. 

For an interesting discussion on the complementarity of S and T see Kwaker- 
naak (1995). 

Discrete Systems 

§3.4 is based on Sung and Hara (1988). A unification of both continuous and 
discrete-time results has been made in Middleton (1991), where the Bode integral 
for T is also derived. 
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This chapter investigates sensitivity limitations in multivariable linear con- 
trol. There are different ways of extending the scalar results to a multivari- 
able setting. We follow here two approaches, namely, one that considers 
integral constraints on the singular values of the sensitivity functions, and a 
second that develops integral constraints on sensitivity vectors. These ap- 
proaches complement each other, in the sense that they find application 
in different problems, and hence both are needed to obtain a general view 
of multivariable design limitations imposed by ORHP zeros and poles. In 
order to avoid repetition, we use the first approach to derive the multi- 
variable version of Bode's integral theorems, whilst the second approach 
is taken to obtain the multivariable extension of the Poisson integrals. Both 
approaches emphasize the multivariable aspects of the problem by taking 
into account, in addition to location, the directions of zeros and poles. 



4.1 Interpolation Constraints 

Consider the unity feedback configuration of Figure 4.1, where the open- 
loop system, L, is a square (i.e., n x n), proper transfer matrix. As in Chap- 
ter 3, let the sensitivity and complementary sensitivity functions be given 
by 



S(s) = [1 + L(s)] 1 , and T(s) = L(s) [I + L(s)]- 1 . (4.1) 
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FIGURE 4.1. Feedback control system. 



We will assume that the open-loop system is formed by the cascade of 
the plant, G, and the controller, K, i.e., 

L = GK . 



The sensitivities in (4.1) are defined at the plant output. A similar pair of 
sensitivities can be defined at the plant input. In this chapter we will focus 
on the sensitivities given in (4.1), but we point out that parallel results can 
be derived for the sensitivities defined at the plant input. 

In the sequel, we will impose the following assumption, which pre- 
cludes the possibility of hidden pole-zero cancelations in the open-loop 
system. 1 

Assumption 4.1. The sets of frequency locations of CRHP zeros and poles 
of the open-loop system L are disjoint. o 

Let the plant and controller have the following coprime factorizations 
over the ring of proper and stable transfer matrices: 



G = D (3 1 Ng = NgDq 1 , 
K^D^Nk =n k d k 1 . 



(4.2) 



It then follows from Chapter 2 that q is a zero of G if and only if there exist 
vectors e C n such that N G (q)Ti = 0 and ¥*N G (q) = 0. and 

T 0 are the input and output zero directions associated with q, and can be 
normalized to be unitary vectors, i.e., such that = 1 and ¥* W 0 = 1 . 
Similarly, p is a pole of G if and only if there exist vectors <Di, 0 0 € C n such 
that D G (p)(hi =0 and ®* D G (p) = 0; and d> 0 are the input and output 
pole directions associated with p. 2 Recall that a zero (pole) direction is said 
to be canonical if it has only one nonzero component. 

Using the factorizations of plant and controller given in (4.2), the sensi- 
tivity and complementary sensitivity functions (4.1) can be expressed as 

S = Dk(D g D k + NgNk)- 1 D g , 

, _ (4.3) 

T = N g (N k N g +D k D g )- 1 Nk . 



Note that the zeros of S and T are easily identified from (4.3). This is for- 
malized in the following lemma. 



1 A relaxed form of this requirement will be considered in §4.3.5. 

2 Note that if G is invertible, then p is a zero of G 1 . 
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Lemma 4.1.1 (Interpolation Constraints). Under Assumption 4.1, the sen- 
sitivity and complementary sensitivity functions must satisfy the follow- 
ing conditions. 

(i) If p e C+ is a pole of G with input direction <D e C n , then 

S(p)<5 = 0, and T(p)0 = O. (4.4) 

(ii) If q e C+ is a zero of G with output direction M/ e C n , then 

W*S(q)=¥*, and ¥*T(q)=0. (4.5) 

(iii) If p e C+ is a pole of K with output direction ® e C n , then 

©*S(p)=0, and $*T(p) = ®*. 

(iv) If q e C + is a zero of K with input direction W e C n , then 

S(q)M' = ¥, and T(q)¥ = 0. 

Proof. Note first that Assumption 4.1 guarantees that there is no pole-zero 
cancelation in S and T. Next, let p e C+ be a pole of G with input direction 
<5 e C n . Then Dg(p)® = 0 and (4.4) thus holds from (4.3). The proof of 
the other cases if similar. □ 

Lemma 4.1.1 is the multivariable generalization of Lemma 3.1.3 in Chap- 
ter 3 and, as was the case with the latter lemma, it translates the open-loop 
characteristics of instability and nonminimum phaseness into properties 
that the functions S and T must satisfy in the CRHP. In the multivariable 
version, these properties also involve directions of zeros and poles. Note 
that the constraints given in (4.4) and (4.5) depend only on poles and zeros 
of the plant and hence hold irrespective of the controller design. 

In §4.2 and §4.3 we will use Lemma 4.1.1 to derive integral constraints 
of the Bode and Poisson type, respectively. 



4.2 Bode Integral Formulae 

In this section we will derive Bode integral formulae for the singular val- 
ues of the sensitivity function. An important obstacle in extending the 
scalar integral constraints to the multivariable case lies in the fact that the 
singular values of an analytic transfer matrix are not themselves analytic. 
A notable step towards the multivariable results was taken by Boyd and 
Desoer (1985), who established inequality versions of the Bode and Pois- 
son integral formulae. These inequalities use the fact that the logarithm 
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of the largest singular value of an analytic transfer matrix is a subhar- 
monic function. 3 By restricting the class of systems under consideration 
— to those for which the multiplicity of the singular values of S is constant 
in the CRHP — Chen (1995) established equality versions of the Bode and 
Poisson integral formulae. These relations were derived using Green's for- 
mula for functions of two real variables (see §A.5.1 in Appendix A), which 
holds for arbitrary functions having continuous second derivatives over a 
region. Bode's integral formulae for the singular values of S will be given 
in §4.2.2, after some preliminary definitions and results. 



4.2.1 Preliminaries 

Given a unitary vector d> e C n , we call the one-dimensional subspace 
spanned by d> the direction of d>. The angle between the directions of two 
unitary vectors dq and d> 2 is defined to be the principal angle (Bjorck and 
Golub, 1973) between the two corresponding subspaces spanned by the 
two vectors. This angle, denoted by Z(d>i , d> 2 ), is given by 

cosZjdL , d> 2 ) — I®! O 2 I • 



As discussed in Bjorck and Golub (1973) and Golub and Van Loan (1983), 
the principal angle between two subspaces serves as a distance measure, 
and it quantifies how well the two subspaces are aligned. 

Our aim in the following subsection is to apply Green's formula to the 
logarithm of the singular values of S. It is thus necessary to extract from 
S all its ORHP zeros. It is well known that a nonminimum phase transfer 
function H admits a factorization that consists of a minimum phase part 
and an all-pass factor. 4 This factorization can be obtained by the following 
sequential procedure, which amounts to repeated use of a formula devel- 
oped in Wall, Jr. et al. (1980). Let q t e C+, i = 1 , • • • , n q , be the ORHP 
zeros of H. Then, H can be factorized as H = H 1 Bi , where 



( s + 9i 



and ®i is the input direction of qi. Note that after this factorization, qi 
is no longer a zero of the transformed transfer matrix H 1 . This procedure 
can be continued to obtain H 1 1 = H v Bt, where Bt(s) m I — 2 Re qt/(s -ft- 
cf i ) ®i®J, and dq, satisfying d>? = 1, is obtained as if it were the direc- 

tion of qi but is computed from H l 1 rather than H. As such, dq need not 
coincide with the input direction of qt; however, it is easy to see that it is a 



3 Recall (cf. §A.3.1 in Appendix A) that a continuous function f is subharmonic if its Lapla- 
cian V 2 f = 3 2 f/3tr 2 + 3 2 f/3cu 2 is nonnegative. 

4 An all-pass transfer function is a stable transfer function such that the magnitude of its 
largest singular value equals one at all points on the imaginary axis. 
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linear combination of the zero directions. By repeating this procedure, we 
obtain a factorization of the form 



h = fi ri B i - 



where it is minimum phase and B t , obtained as described above, is an 
all-pass factor corresponding to qr. 

Let pt, i = 1 , . . . ,n p , be the poles of the open-loop system L in the 
ORHP, repeated according to their geometric multiplicities. 5 Under As- 
sumption 4.1, it follows from Lemma 4.1.1 and the factorization described 
above that S can be expressed as 






(4.6) 



where S is minimum phase and B 
Pi, given by 

Bi(s) = I- 

We note that the all-pass factors in the factorization (4.6) can be constructed 
independently of the controller if the controller is stable. In particular, suppose 
that Assumption 4.1 holds and that the plant and controller are expressed 
as in (4.2). Assume further that the controller denominator D K has no 
ORHP zeros. Then, it is clear from the expression for S in (4.3) that the 
all-pass factors of the factorization (4.6) can be computed from Dg alone. 
This will be relevant in the following section when the interest is to ob- 
tain performance limitations that can be computed before selecting any 
particular controller design. 

In the remaining of §4.2, we make the following assumption. 

Assumption 4.2. 

(i) The closed-loop system of Figure 4.1 is stable. 

(ii) lim sup Rcf(L(s)) = 0. 

R ^°° S6C + 



i is the all-pass factor corresponding to 

- ZRcpt 
(S + Pi) 



(iii) The singular values of S in (4.6), i.e., Oi(S(s)), I = 1 , • • • ,n, have 
continuous second order derivatives for all s e C+. 



5 Recall that the geometric multiplicity of a pole of H = D 1 N is equal to the deficiency 
in rank of D at the frequency of the pole. 
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Assumption 4.2-(i) is the same as for the SISO case, and amounts to 
the analyticity of S in the CRHP. Assumption 4.2-(ii) states that the largest 
singular value of the open-loop transfer function has a roll-off rate of more 
than one pole-zero excess. It will hold, for example, if each entry of L has 
relative degree larger than one. 6 Assumption 4.2-(iii) is necessary for the 
use of Green's theorem. A sufficient condition for this assumption to hold 
is that the multiplicity of Ot(S(s)), i = 1, • • • , n, be constant for all s e 
C+ (Chen, 1995) — which in fact guarantees that ot(S) has continuous 
derivatives of all orders in the CRHP. 

It is important to note that, even if S is analytic in the CRHP and the 
singular values of S have continuous derivatives of all orders in the CRHP, 
the function at(S(s)) is not, in general, a harmonic function (Boyd and 
Desoer, 1985; Freudenberg and Looze, 1987). This precludes the use of 
Cauchy's and Poisson's formulae, which apply to analytic and harmonic 
functions. 

We end this subsection with a technical lemma that will prove useful in 
the subsequent analysis. 

Lemma 4.2.1. For any s € C+ such that s f q t , we have that 



^Br 1 (s)) = 


s + q t 




(4.8) 


s-qt 




a j (Br 1 ( s )) = - 


1, 1=2, •• 


• } n , 


(4.9) 



where Bt is given by (4.7). 



Proof. Using the matrix inversion lemma (Golub and Van Loan, 1983), we 
have, for s qt. 



h 2Re^ 
(s + q t ) 

2Req. 
b —chi 

s — qt 



„ 1 

1 1 — 2Re qtOfd) i /(s + q t ) 



Consider next the matrix Tt, such that [(Dt, Til form an orthonormal basis 
of C n . Then I = Oh®* + TtT*, and 



Br’(s) = d>t<I>* + TtT* + 

#>i n] 



2Reqi 



6 This follows from the inequality <r(A) < nmax] <tj<n |uij \, which holds for any A = 
[a tj ] e C nxn (see e.g., Golub and Van Loan, 1983). 
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Thus 



0'j(B i 1 (s)) = CTj 





and the result follows. 



□ 



4.2.2 Bode Integrals for S 

In this section we will state the Bode integral theorem for the logarithm of 
the singular values of the sensitivity function. The proof involves the use 
of Green's formula and a careful computation of contour integrals. Since 
it is rather long and tedious, we defer it to §B.l of Appendix B. 

The main result of the section is the following. 

Theorem 4.2.2 (Bode Integral for S). Let S be factored as in (4.6). Then, 
under Assumption 4.2, 



log Oj (S(jco)) dm = Fj -Kj., (4.10) 

Jo 

where 

Fj = j JJ cr V 2 log dj (S(a + jtu)) dodo) , and 

U# 

Kj = Urn J / R log dj Br 1 (Re i0 ) j cos 0 d9 . 

Proof. The proof follows by applying Green's formula (A.30) in Appendix A 
for Q. equal to the typical semicircular domain of radius R into the ORHP, 
and the choices of functions f(s) = log <jj (S (s) ) and g(s) = log(|ri + s|/|r| — 
s|), where rj > R. The details are given in §B.l of Appendix B. □ 

Note that Fj and Kj are functions of the particular factorization of S 
given in (4.6). As discussed before, this factorization will, in general, de- 
pend on the choice of controller. It is possible, however, to derive an in- 
equality that is independent of the controller as long as the controller is 
stable. This is stated in the following corollary. 

Corollary 4.2.3. Let the plant be given by G = D g ’Ng, and assume that 
the controller K is stable. Let S be factorized as in (4.6), where the all-pass 
factors are computed from Dg alone. Then, under Assumption 4.2, 

J log cr(S(jcu)) do) > R lim J Rlogcf Br 1 (Re’ 9 )^ cos 0 d0 . 



(4.11) 
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Proof. If the controller is stable, then it is possible to factorize S as in (4.6), 
where the all-pass factors are computed from Dg alone. Consider next 
(4.10) for j = 1, i.e., focusing on the largest singular value of S. Then the 
function a(S) is subharmonic in C + (Boyd and Desoer, 1985; Freuden- 
berg and Looze, 1987). This implies that V 2 logcf(S) > 0 and hence Fi > 0. 
Inequality (4.11) then follows. □ 

The integral constraint given in (4.10) is an extension of Bode's integral 
given previously for scalar systems in Theorem 3.1.4 of Chapter 3. Note 
that for SISO systems, the singular values, a,- (S), all collapse into |S|. Since, 
S is analytic in the CRHP it follows that log |S| is harmonic in the CRHP. 
Hence V 2 log |S| = 0 in C+, giving Fj = 0 in (4.10). We next focus on Kj 
in (4.10). Note that for SISO systems, the all-pass factor in (4.7) have the 
form Bt(s) = (s — Pi)/(s + p t ). Using the uniform convergence theorem 
(Levinson and Redheffer, 1970, p. 335), and Example A.8.7 of Appendix A, 
Kj in (4.10) can be written as 

^ ( n/1 |Re i0 +p | 

Kj = Y \ lim R log ■- cos8d9 

J -tt/2 ° | Re 10 — Pi | 

= |C Re ^ H ( ,+E f ! ) - Ri °« ( , - E f ! )] “ sede 

pTT/2 

= y\ Retp^-’ 0 +p i e H0 )cos0d0 

J-n/2 

n v |-7l/2 

= 2 V" Rept cos 2 0 d0 

; | J—tz/2 

= 7t^Repi . 

i=1 

Hence, for scalar systems, (4.10) reduces to (3.13) (particularized to the 
case S(oo) = 1). 

We next discuss the terms Fj and Kj in (4.10) for the general multivari- 
able case. It is easy to see from the proof of Theorem 4.2.2 (see §B.l in 
Appendix B) that Fj will be present for both stable and unstable open- 
loop systems. In particular, for j = 1, i.e., focusing on the largest singu- 
lar value of S, we have seen in the proof of Corollary 4.2.3 that Fi > 0. 
We thus conclude that, even for open-loop stable systems (satisfying As- 
sumption 4.2), the Bode integral of the largest singular value of S has a 
nonnegative value. 

It is also clear from the proof of Theorem 4.2.2 that the terms Kj com- 
pletely quantify the effect of open-loop unstable systems on the Bode in- 
tegrals for S. It is easy to see that Kj > 0. Indeed, this follows from the 
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inequality 

a; (nerw 9 )) >n^( B r ri ( Reie )) - 

and the fact that the RHS above equals 1 by Lemma 4.2.1. Thus, open-loop 
unstable poles contribute an additional nonnegative term, which has the 
potential for additional limitations upon sensitivity properties. 

In order to obtain a better understanding of the multivariable nature 
of the result in Theorem 4.2.2, we will focus on some particular cases, for 
which the term Kj has a simpler explicit expression and bound. It is in- 
structive to first examine two extreme cases. The first case corresponds to 
V?Vj = 0 for all i,!j = 1, • • ■ ,n p , i j, and the second case corresponds 
to Vi = V 2 = • • • = V np . For simplicity, we assume that n p < n. We then 
have the following result. 

Proposition 4.2.4. Let S be factorized as in (4.6) and assume, without loss 
of generality, that Re p 1 >;•••> Re p Up . Also, let n p < n. Then, under 
Assumption 4.2, 

(i) if V?Vj = 0 for all i, ) = 1 , • • • , n p , i ^ j, we have that 



logaj(S(jco))dcu =7tRepj +Fj , 
Jo 



j = 1 , - - - , rt p , (4.12) 



log CTj (S(jaj)) dtu = Fj , j = u p + 1, • • • ,n ; 
Jo 

(ii) if V x = V for all i = 1 , • • • , n p , we have that 

| logdtSQcu)) dco = 7t ^ Repr -f'Fy., 

and 

logaj(S(jco)) dco = Fj , j=2, 

Jo 

Proof. In case (i), it is easy to show that 



(4.13) 

(4.14) 

(4.15) 



Consider next the matrix T, such that [Vi , • • • , V np , T] form an orthonor- 
mal basis of C n . Then I = V X V* + YY*, and by a similar argument 
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to that used in the proof of Lemma 4.2.1, it follows that 

/ 

a s (l I B . ’( s >) = *> 

V 

It is then clear from (4.10) and the above relation that (4.13) holds. As for 
(4.12), a straightforward manipulation shows that for s € C+ and |s| > R 
with R being sufficiently large, the inequality 



S+P! > 


S+P 2 


s -pi 


S-p 2 



holds if Re pi > Rep 2 , as was assumed. Then, as R — > oo 

This gives K,- in (4.10) equal to 7tRepj, thus showing (4.12). 

For case (ii), one can construct a matrix T whose columns form an or- 
thonormal basis of C n together with ML This leads to the expression 

nBr 1 (s) = [¥ T] 

: ; l4f 

and the rest of the proof is similar to that of case (i). □ 

Proposition 4.2.4 suggests that the limitations imposed by open-loop 
unstable poles in multivariable systems are related not only to the location 
in frequency, but also to the directions of poles (or rather a linear combina- 
tion of such directions) and further to the relative geometric configuration of 
these directions. Case (i) corresponds to the situation where the pole di- 
rections are mutually orthonormal, for which the integral pertaining to each 
singular value is related solely to one unstable pole (with a corresponding 
distance to the imaginary axis), as if each "channel" of the system is de- 
coupled from the others. Case (ii) corresponds to the situation where all 
the pole directions are parallel, for which the unstable poles affect only the 
integral of the largest singular value, as if the channel corresponding to 
this singular value contains all unstable poles. 

The following result — stated without proof — specializes Theorem 4.2.2 
to the case of two open-loop unstable poles, and it further shows that the 
relative geometry of the directions of these poles is indeed crucial in the 
study of sensitivity limitations. 



n — 1 

i=7 s “ Pi 



s + Pi 




\ 


s Pi 


S + Pn p 






S Pn p 

! n _ np _ 


/ 
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Theorem 4.2.5 (Chen, 1995). Let n p = 2 and let the conditions of Theo- 
rem 4.2.2 hold. Then 





loga(S(jco)) dcu = a(l,2) +Fi , 
Jo 


(4.16) 




[ logcr 2 (S(ju>)) dcu = b(l ,2) + F 2 , 
Jo 


(4.17) 


and 






where 


[ logCTj(S(ju))) dcu = Fj , j = 3, 

Jo 


(4.18) 



a (i, j) = j ^Re(p l +p j ) + ^/[Re(p l -pj)] 2 +4Rep i Repj cos 2 , 

b(i, j) = j ^Re(p l +pj)-y / [Re(p l -pj)] 2 +4Rep i Repj cos 2 ZOFt,^ . 



The above result fully characterizes the limitation imposed by a pair 
of open-loop unstable poles on the sensitivity reduction properties. This 
limitation depends, not only on the distances of the poles to the imaginary 
axis, but also on the principal angle between the pole directions. 

Using similar arguments as in the proof of Theorem 4.2.5, Chen (1995) 
obtained the following lower bounds for the Bode integral of the largest 
singular value of the sensitivity function. 

Corollary 4.2.6 (Chen, 1995). Let the conditions of Theorem 4.2.2 hold. 
Then, for any <D e C n satisfying 0*0 = 1, we have 

[ logg(S(ja>)) da) > n Reptcos 2 Z(0,¥j) + Fi , (4.19) 

Jo i=1 

and, in particular, for any j = 1 , • • • , n p . 



[ log <x(S(jcu)) dcu > 7t^~ Re pt cos 2 Z(Wj,Wj ) + Fi 
Jo 



(4.20) 



From Theorem 4.2.2 and Corollary 4.2.6, it can be inferred that there will 
exist a frequency range over which the largest singular value of the sensi- 
tivity function exceeds one if it is to be kept below one at other frequen- 
cies. We will further see in §4.2.3 below that, in the presence of bandwidth 
constraints, this will result in a sensitivity trade-off in different frequency 
ranges. The above results also show unique features of multivariable feed- 
back systems. First, owing to the fact that log cr( S ( j oj)) is a subharmonic 
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function in the CRHP, the results show (via the terms Fj ) that design lim- 
itations due to bandwidth constraints are, in a sense, more stringent than 
in scalar systems. 7 Moreover, how stringent these limitations are depends 
on the Laplacian of log cr( S ( j uj ) ) . The second multivariable feature high- 
lighted by the results, is that the additional cost associated with open-loop 
unstable poles (captured in the terms Kj) is a function not only of the posi- 
tion of the poles but also of the pole directions. Moreover, Proposition 4.2.4 
and Theorem 4.2.5 show that the relative geometry of the pole directions 
is also important. 

A multivariable version of the Poisson integral for the largest singular 
value of the sensitivity function can be used to study the effect of open- 
loop nonminimum phase zeros upon sensitivity limitations. This result 
was given in Chen (1995), who developed an extension of the Poisson in- 
tegral formula for real functions f : C — » R with continuous derivatives 
of all orders in C+, but that are not necessarily harmonic functions. As 
expected, this new formula has an additional term involving the Lapla- 
cian of f . Accordingly, the Poisson integral theorem for the largest singular 
value of the sensitivity function displays a term depending on the Lapla- 
cian of log cf(S(ja>)). This Poisson integral also shows that the sensitivity 
reduction ability of the system may be severely limited if the system has 
both open-loop unstable poles and nonminimum phase zeros, especially 
when these poles and zeros are close to each other and the principal angle 
between their directions are small. More discussion on this version of the 
Poisson integral for multivariable systems can be found in Chen (1995). 

As a final comment, we remark that using standard modifications to 
the proof of Theorem 4.2.2, similar to the ones used in the proof of The- 
orem 3.1.4 of Chapter 3, it is possible to show that open-loop poles on 
the imaginary axis do not contribute to the values of the Bode and Pois- 
son integrals. Also, parallel results can be obtained for the complementary 
sensitivity function. 



4.2.3 Design Interpretations 

In this section we briefly show the utility of the integral constraint (4.10) 
to study design trade-offs imposed on sensitivity reduction by open-loop 
unstable poles in conjunction with bandwidth constraints. These trade- 
offs are similar to those obtained in §3.1.3 of Chapter 3 for scalar systems. 
For the purpose of illustration, we will consider limitations related to the 
largest singular value of S, which we have seen in Chapter 2 has relevance 
in quantifying feedback properties of the closed-loop system of Figure 4.1. 



7 This conclusion holds if the multivariable problem is approached from a singular value 
perspective. Yet we will see in §4.3 that, when studying integral constraints on sensitivity 
vectors, the trade-offs appear to be alleviated with respect to the scalar case. 
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Following §3.1.3, we will assume that the largest singular value of the 
open-loop system satisfies the bound 

a(L(jm)) < — p < e < 1 , Vco 6 [u) c ,oo] , (4.21) 

where 6 > 0 and k > 0 are given constants. A bandwidth constraint like 
(4.21) may be necessary to ensure robust stability against uncertainty in 
the plant model (see Chapter 2). Note that a different upper bound of the 
form (4.21) may hold for each singular value. 

Next, assume that the feedback loop of Figure 4.1 has been designed to 
achieve the following reduction specification 

cf(S(jm)) < a , Vm € [— u)i , u)i] , (4.22) 



where tui < m c and a > 0 is a given small constant. The following re- 
sult shows that the reduction specification (4.22), together with the band- 
width constraint (4.21), can be achieved only at the expense of sensitivity 
increase over the range [mi , o> c ]. 

Corollary 4.2.7. Let the conditions of Theorem 4.2.2 hold. In addition, 
suppose that (4.21) and (4.22) are satisfied for some mi and m c such that 
mi < m c . Then, 



sup loga(S(jm)) > ^ ^ ^ jY t *'Ki + mi log ^ + m c log(l -e)| . 

(4.23) 

Proof. The proof is similar to that of (3.21) in §3.1.3, and follows using 
(4.10) together with the bounds (4.21) and (4.22), and the observation that 
for m > m c 



a(S(jm)) 



1 

H(l + L(;jm)) 



1 

1— <f(L(jm)) 

1 

1 - 6/m k+1 ' 



□ 

Similar to its scalar counterpart, given in (3.21) in Chapter 3, the bound 
(4.23) shows that any attempt to increase the area of sensitivity reduction, 
by requiring a to be small and/or mi to be close to m c , will necessarily re- 
sult in a large sensitivity peak in the range (m i , m c ) . Note that the constant 
Ki — which is the multivariable version of the term n Y_ Re Pt in (3.21) — 
can be precisely evaluated for some particular cases as shown in Proposi- 
tion 4.2.4 and Theorem 4.2.5. In the general case Ki is nonnegative, thus 
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potentially increasing the sensitivity peak. The main multivariable feature 
appears in the term Fi . As we have seen, the constant Fi is also nonneg- 
ative, leading to an additional possibility of an increase in the sensitivity 
peak. 

We remark that similar trade-offs can be analyzed by means of the Pois- 
son integral formula for the largest singular value of the sensitivity func- 
tion (Chen, 1995). 



4.3 Poisson Integral Formulae 

In this section, we use the approach of Gomez and Goodwin (1995) to 
obtain integral constraints — of the Poisson type — on columns of the sen- 
sitivity function. These constraints are useful in the study of performance 
limitations in multivariable feedback problems where structural features 
— such as diagonalization, triangularization, etc. — are of interest. The re- 
sult uses the Poisson integral formula developed in §A.6.1 of Appendix A. 
Similar integral constraints can be obtained on rows of the complementary 
sensitivity function. The interested reader is referred to Gomez and Good- 
win (1995) for this latter analysis. 



4.3.1 Preliminaries 

In this subsection we introduce some preliminary notions. We denote by 
Sik, the element in the i-row and k-column of the n x n square trans- 
fer matrix S. If ¥ is a vector in C n , we denote its elements by 4>i, i = 
1 , . . . , n, i.e., ¥ = [r|), , . . . , rpy *. Also, we introduce the index set Jv = 
{i e DM : i|h ^ 0} as the set of indices of the nonzero elements of ¥. 

As in Chapter 3, given a set Zk = {st, i = 1 , . . . , Uk} of complex numbers 
in the ORHP, we define its Blaschke product as the function 



1 A s + s t 



If Zk is empty, we define B k (s) = 1, Vs. 

In the remainder of §4.3, we make the following assumption. 

Assumption 4.3. 

(i) The closed-loop system of Figure 4.1 is stable. 

(ii) The open-loop system L is a proper transfer matrix. 



Assumption 4.3-(i) is the same as for the Bode integral given in §4.2. 
Assumption 4.3-(ii) is necessary to restrict the behavior at infinity of the 
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sensitivity function, and is more relaxed than Assumption 4.2-(ii) used to 
derive the Bode integral. 

Next, let ¥ e C n , ¥ ^ 0, be the output direction of an ORHP zero of 
the plant G, as described in Lemma 4.1.1 (ii). Consider the vector func- 
tion ¥*S : C — > C n , whose n elements are proper, stable, scalar rational 
functions. Pick one of these elements, say 

p k (s)^^rl»*S ik (s) , (4.24) 

i=1 

where k is in and let B k be the Blaschke product of the zeros of p k in 
the ORHP. Then, the function p k (s) = B k 1 (s)p k (s) is proper, stable, and 
minimum phase, which implies that log p k (s) is analytic in the ORHP and 
satisfies the conditions of the Poisson integral formula (see Theorem A.6.1 
in Appendix A). In the following subsection we will use this information 
to derive Poisson integrals for S. 

4.3.2 Poisson Integrals for S 

In the following theorem, we translate the interpolation constraint given 
in (4.5) into Poisson integrals on the columns of S. 

Theorem 4.3.1 (Poisson Integral for S). Let q = cr q + jcu q , a q > 0, be 
a zero of the plant G, and let ¥ e C n , ¥ ^ 0, be its output direction, as 
described in Lemma 4.1.1 (ii). Then, under Assumption 4.3, for each index 
kinJ v , 

S L, 108 \L + (,?,- a. H da> = >»« 'A ' (1)1 • t 4 - 25 ) 

where B k is the Blaschke product of the ORHP zeros of p k in (4.24). 

Proof. The proof is an application of the Poisson integral formula, as in 
Theorem 3.3.1 in Chapter 3, to the scalar elements p k of the vector function 
¥*S : C — > C n , which, under Assumption 4.3, are proper, stable, rational 
functions. 

Let p k in (4.24), where k is in 1^, be one of these elements, and let B k 
be the Blaschke product of the zeros of p k in the ORHP. As noted before, 
we can then apply the Poisson integral formula to the function log p k (s), 
where p k (s) = B k 1 (s)p k (s). Evaluating this integral at s = q, and using 
the fact that |p k (jcu)| = |p k (jcu)| yields 

- [ log frKS ik () co) gq -ydu) =log B k 1 (q)V^S ik (q) 

Ifrr | cr^ + lcoq-cu)^ I f-j 

= lo g l B k 1 (q)l + log l^icl . 

(4.26) 
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where the last step follows from the interpolation condition V*S(q) = 
given in (4.5) (notice that iji k 7 ^ 0 by assumption). Since 



Cq 

CTq + (tOq - CU) 2 



dcu = 1 , 



subtracting log |t|>£| from both sides of (4.26) yields (4.25), thus completing 
the proof. □ 

Note that the result in Theorem 4.3.1 depends on the particular choice 
of controller. This is due to the presence of the Blaschke product B k of 
ORHP zeros of p k on the RHS of (4.25). Indeed, p k in (4.24) is formed 
by combining entries of S, which clearly are functions of both plant and 
controller. However, the following corollary establishes a constraint that 
holds for any controller, and can therefore be used to identify, a priori, 
design limitations imposed by plant characteristics. 

Corollary 4.3.2. Under the conditions of Theorem 4.3.1, the sensitivity 
function S satisfies, for each index k in 1\y, 

L 108 Is + <£ - <427) 

Proof. The proof follows from (4.25), on noting that B k 1 (s)| > 1 at any 
point s in C + , and so log |B k ’ (q)| > 0. □ 

Theorem 4.3.1 and Corollary 4.3.2 establish that, for each nonminimum 
phase zero of the plant, q, there is a set of integral constraints that limit 
the values of S on the j co-axis in an intrinsically vectorial fashion. Observe 
that, depending on the number of nonzero elements of the output direc- 
tion V associated with the zero of the plant — i.e., the number of nonzero 
elements in the index set — up to n integral constraints of the form 
(4.25) can be stated, each corresponding to a column of S. Moreover, if v 
is the geometric multiplicity of the ORHP zero of the plant, i.e., the di- 
mension of the (left) null space of the matrix N (q), then up to v integral 
constraints of the form (4.25) arise for each column of S. Since the compo- 
nents of the null space are linearly independent, it is expected that each 
integral constraint will give different information. Hence, it is reasonable 
to expect that, the greater the drop in rank caused by a particular zero, the 
more restrictive the constraint becomes . 8 

Note that, if the zero direction happens to be canonical, i.e., the index 
set Tf has only one element, k say, then the constraints reduce to those 



8 If the geometric multiplicity of a zero is greater than one, then there is no unique way of 
choosing a basis for the corresponding null space. Each choice of basis, in principle, gener- 
ates alternative constraints. However, these constraints are interrelated and do not provide 
independent information regarding performance limitations. 
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of the SISO case for the element Skk- This is seen more clearly from the 
following corollary. 

Corollary 4.3.3. Under the conditions of Theorem 4.3.1, the diagonal ele- 
ments, Skk/ of the sensitivity function satisfy, for each index k in Ty, 



j°° logISk 



■\)<u 



log I ySicicOaO 



Oq + (a 



(4.28) 



| LILi Sik(jcu) | CT 2 + (cUq - cu ) 2 
Proof. The LHS of (4.27) can be alternatively written as 

[ log Skk M+ZtHt 1 I 2 T 7 w dcu = 

Loo ^ p^£SkkJ ff 2 +(co q -tu ) 2 

oc oc \tr^\ 

[ loglSkkl 2 . 7 gq r^-d-CUd- f log X ~ 1 7 2 gq ry dtU , 

J-oo o 2 + (cu q -m ) 2 & |^*S k kl o 2 + (cu q -cu ) 2 



from which (4.28) follows. 



n 



As discussed before, if the zero direction is canonical, then the index 
set 3\y has only one element, k say. In this particular case. Corollary 4.3.3 
gives, 

[ log |SkTc(jeo)| 2 , Cq y do) > 0 , 

J— oo ^q + (.CUq CUJ 

which is the same constraint that would hold for a scalar system having 
a nonminimum phase zero at s = q and a sensitivity function equal to 
Skk- Corollary 4.3.3 also shows that, if the zero direction is not canonical, 
i.e., the set 3\v has more than one element, then additional degrees of free- 
dom arise in multivariable systems, which can potentially be exploited to 
reduce the cost associated with nonminimum phase zeros. This will be 
analyzed further in the following two sections. 

It is clear from the previous discussion that the results given above dis- 
play the essential multivariable nature of the problem, in the sense that the 
constraints stress the importance of directions of ORHP open-loop zeros 
and poles in connection with spatial — i.e., related to the structure of the 
transfer matrix — sensitivity allocation. In the following section we ana- 
lyze design implications and trade-offs induced by the integral constraints 
just given. 
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4.3.3 Design Interpretations 

As in the case of scalar systems. Theorem 4.3.1 and Corollary 4.3.2 can be 
used to give insights into the frequency domain trade-offs in sensitivity. 
A straightforward corollary of these results emphasizes the vectorial na- 
ture of the associated trade-offs. Let 0 1 = [0, a>i] denote a given range 
of frequencies of interest, and assume that the k-column of S satisfies the 
following design specifications: 

|Sik(jcu)| < anc for cu in [— mi , cui], i = l,...,n, (4.29) 



where atk, i — 1 , . . . , n, are small positive numbers. Let 0 q (o>i ) be the 
weighted length of the interval [—mi , cui], as defined in (3.33) in Chap- 
ter 3, which can be expressed as 




We then have the following corollary. 

Corollary 4.3.4. Assume that all the conditions of Theorem 4.3.1 hold. 
Then, if the k-column of S, where k is in 1^, achieves the specifications 
given in (4.29), the following inequality must be satisfied. 



||s kk |U + X ft IM~> 



a k k + Z ?=1 Tt a ik 



(4.30) 



Proof. Dividing the range of integration and using the weighted length of 
the interval [— cui , cui], the inequality (4.27) implies 

tog ^ max ^ ] |£ f^S ik (j<u)| 0 q (coi>b 
l0 S ilft^kOw) [7t-0 q (coi)] > 0 . 

|| i=1 Vk || ■ 

Exponentiating both sides above yields 









Using the specifications (4.29) and the triangular inequality, v 



a ^+Z ft k* 



|Sk k ||«+£ ft Me 



C«,)] 

> 1 . 
have 

I (cu, )] 

> 1 i 
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from which (4.30) follows immediately. 



□ 



As in the SISO case, the above corollary shows that integral relation 
(4.25) implies lower bounds on the infinity norm of elements of S. Notice 
that the exponent on the RHS of (4.30) is a positive number and its base is 
likely to be larger than one if the coefficients <%ik are small enough; hence, 
the more demanding the specifications, the larger these lower bounds are. 

If the zero direction is not canonical, an important difference in the 
MIMO case is that the lower bounds apply to a combination of norms of el- 
ements, which somehow relaxes the constraint over the SISO case (where 
there is only one element). Also, the lower bounds are smaller than in the 
SISO case due to the presence of extra positive terms in the denominator of 
the RHS of (4.30). As a consequence, when the zero direction is not canon- 
ical, there is an alleviation of the cost associated with the corresponding 
zero as compared with the scalar case. To gain further insight into these 
ideas, we will next consider the special case of a diagonally decoupled 
design. 



4 . 3.4 The Cost of Decoupling 

Multivariable systems are, by their intrinsic nature, subject to coupling 
between different outputs and inputs. This means that, in general, one in- 
put affects more than one output and, conversely, one output is affected 
by more than one input. A natural approach to tackle the additional de- 
sign difficulty arising from this interaction is to devise methodologies that 
translate — or approximate — the MIMO problem into a collection of 
SISO problems. There are alternative ways to do this, but they all involve 
achieving special structures for the closed-loop transfer matrices in such 
a way that the coupling is eliminated or is easier to handle. Examples of 
these decoupling methodologies include diagonalization, triangulariza- 
tion, diagonal dominance, etc., which have been frequently reported in 
the literature (e.g.. Hung and Anderson, 1979; Rosenbrock, 1969; Weller 
and Goodwin, 1993; Desoer and Giindes, 1986). 

In all of the above references, limitations imposed by nonminimum phase 
zeros are discussed as an additional complication. Desoer and Giindes 
(1986) have made this more precise by showing that, in order to achieve 
diagonal decoupling, the multiplicity of nonminimum phase zeros may 
need to be increased. This, in turn, is associated with performance penal- 
ties such as increased undershoot and rise times. 

Following Gomez and Goodwin (1995), we next study the cost of de- 
coupling in the context of integral constraints. Note that, for a diagonally 
decoupled system, the elements Stk, for i / k, are zero. It then follows 
from Corollary 4.3.3 that, for each k in 3\y, the diagonal element Skk satis- 
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fies the integral constraint 

J log ISidc (jcu)| g 2 + _ ^2 du; > 0 • ( 4 -31) 

Also, if the sensitivity function is diagonal, and the diagonal element Skk, 
where k is in ¥f, is designed to satisfy |Skk(jtt>)| < akk for cu e [— u)i , toi]. 
Corollary 4.3.4 gives 

Bg(an) 

/ 1 XTt-Qqto)!) 

hl -Hs) - <432) 

To investigate the cost of diagonal decoupling, we compare the constraint 
(4.28) with (4.31), and the lower bound (4.30) with (4.32). 

We first study the case where the dimension of the null space corre- 
sponding to the zero at s = q is one. In this case we note that, if the zero 
direction ¥ has more than one nonzero element, then it seems feasible to 
achieve a negative value for the RHS of (4.28) by making off-diagonal ele- 
ments in the sensitivity function nonzero. Comparing this with the result 
in (4.31), where the RHS is zero, indicates that when ¥ has more than one 
nonzero element, it is possible to exploit nondiagonal sensitivity entries 
so as to ameliorate the constraints on the diagonal element. Thus, if ¥ has more 
than one nonzero element, it is possible to have a joint spatial (i.e., non- 
diagonal) and frequency trade-off in sensitivity allocation. Similar remarks 
apply to the bounds on ||Skk|joo shown in (4.30) and (4.32). In the latter 
case, nondiagonal decoupling allows atk, for i ^ k, to be greater than 
zero and again, provided the vector ¥ has more than one nonzero element, 
then the RHS of (4.30) can be made less than the RHS of (4.32). Moreover, 
as already noted in §4.3.3, the LHS of (4.30) also contains positive terms 
related to the norms of the off-diagonal elements, which do not appear in 
(4.32). In this way, the cost induced by the ORHP zero is somehow shared 
among various elements of the column. 

Interestingly, having more than one nonzero entry in the zero direction 
¥ means that the particular nonminimum phase zero in question has its 
effects associated with a linear combination of more than one output. Con- 
versely, if ¥ is canonical, i.e., it has only one nonzero element, then the zero 
affects only one output. In the latter case, one might expect that it is un- 
helpful to make the sensitivity nondiagonal and this is precisely the point 
made above. 

The preceding arguments have focused on the case where the dimen- 
sion of the null space is one. For cases where the dimension of the null 
space is greater than one, then the issue arises as to whether or not there 
exists a basis for the null space that is canonical, i.e., it uses only unit vec- 
tors with only one nonzero entry. In cases where such a canonical basis 
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exists, 9 it would seem, by extension of the arguments used above for the 
one dimensional case, that there is no apparent benefit to be gained by 
exploiting spatial sensitivity trade-offs. 

As a final remark, note that the inequality (4.32) is the same as for the 
scalar case (see §3.3.2 in Chapter 3), and can be used to describe the water- 
bed effect for nonminimum phase systems: reducing the sensitivity in one 
frequency range causes it to rise in other ranges. However, (4.30) shows 
that, if decoupling is removed as a constraint, then spatial as well as fre- 
quency trade-offs are possible. Thus, the water-bed effect on the diagonal ele- 
ments of the sensitivity function may be ameliorated by allowing off-diagonal 
elements to be nonzero. Nevertheless, this requires directional conditions 
(noncanonical zero directions) so that the cost associated with the integral 
constraints can be shared by different outputs. 



4 . 3.5 The Impact of Near Pole-Zero Cancelations 

Cancelations of ORHP zeros and poles between plant and controller of the 
feedback loop of Figure 4.1 is highly undesirable because it leads to loss of 
internal stability (cf. §2.2.1 in Chapter 2). In the multivariable case, these 
cancelations involve not only frequency locations of zeros and poles, but 
also their directions. For example, if the plant and controller are expressed 
as in (4.2), then the closed loop will not be internally stable if Dg and N K 
share an ORHP zero with the same input direction (Gomez and Goodwin, 
1995). It is easy to see that, if this is the case, then Dg and Nk are not 
right coprime. Loss of internal stability also occurs if Ng and Dk are not 
right coprime, if Nq and Dk are not left coprime, and if Dq and Nk are 
not left coprime (Vidyasagar, 1985). All these four cases are multivariable 
extensions of unstable pole-zero cancelations. Note that Assumption 4.1 
precludes any of these cancelations by not allowing even frequency coin- 
cidence of zeros and poles. 

Approximate unstable cancelations are also problematic. Indeed, we 
have seen in Chapter 3 that, for scalar systems, severe sensitivity peaks 
arise if there exist open-loop zeros and poles at near frequencies. This can 
be seen clearly from the values of the Poisson integral constraints (3.29) 
and (3.30) in §3.3, where the Blaschke products on the RHSs tend to in- 
finity as ORHP zeros approach ORHP poles. We will see next that similar 
conclusions hold in the multivariable case regarding approximate unsta- 
ble cancelations — keeping in mind that these cancelations involve both 
frequency and directions. To analyze the effect of these unstable multivari- 
able cancelations, we consider separately the case where the directions are 



9 One instance for the left null space of the plant to have a canonical basis is when the q- 
interactor (Weller and Goodwin, 1993) associated with the zero q is diagonal (Gomez and 
Goodwin, 1995). 
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the same but the poles and zeros are close in frequency, and the case where 
the locations of poles and zeros are the same but the directions are close. 

Let q e C+ be a zero of G with output direction ¥ e C n . It follows 
from Theorem 4.3.1 that, under Assumption 4.3, the sensitivity function 
satisfies the integral constraint (4.25). Consider first the case that the vector 
¥ is also an output direction of a zero qi ^ q of D K , i.e., the controller has 
a pole at s = qi such that ¥* D k ( q i ) =0. Inspection of the expression for 
S in (4.3) clearly shows that s = qi is a zero of the vector function ¥*S, 
i.e., each of its elements Pk defined in (4.24) has a zero at s = q i . Thus, the 
Blaschke product of zeros of Pk, B k , can be expressed as 



Bk(s) = 



Bk(s) 



where Hk > 1, and where Bk(s) is the Blaschke product of the remain- 
ing zeros of Pk- Using the above expression in (4.25), and the fact that 
B k 1 (s)| > 1 at any point s in C + , we have that 



lo § t 



q + <4 1 
q - qi ’ 



(4.33) 

for each k in 3\y, i.e., such that iK ^ 0. We can conclude from (4.33) that, 
similar to the scalar case, the lower bound on the RHS becomes arbitrarily 
large when qi approaches q. This, in turn, would lead to high peaks on 
the magnitudes of the elements of S (and of T since S + T = I) on the 
k-column. Similar arguments apply when an unstable pole of the plant 
has the same direction as a nonminimum phase zero of the controller. In 
this case, it is also possible to show that, as the location of the zero of the 
controller becomes close to that of the pole of the plant, large peaks in T 
will occur. 

Another alternative for a near multivariable cancelation is when the 
controller has an unstable pole at the same frequency, q say, at which the 
plant has a nonminimum phase zero, but with a slightly different direc- 
tion. Let ¥ e <C n be the output direction of the zero of the plant, and let 
¥ + e be the direction of the pole of the controller. Then, cases (ii) and (iii) 
of Lemma 4.1.1 hold, i.e.. 



¥*S(q) = ¥* , and 
(¥* + e*)S(q) = 0 , and 



¥*T(q) = 0 ; 

(¥* + e*)T(q) = ¥* + e* . 



The above interpolation conditions lead to 



e *S(q) = — ¥* , 



and e*T(q) =¥* + e* , 
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which, using any compatible matrix and vector norm, imply that 

||S(q)|| > IWIel , 

||T(q)||>l^+e|/|e|. 



Hence, if |e| < |V| then ||S(q)|| and ||T(q)|| must be large. Consider, for ex- 
ample, the Euclidean norm for vectors and the infinity norm for matrices, 
i.e., the maximum singular value of the matrix. Then the bounds above 
show that a(S(q)) and <r(T(q)) will become very large if |e| approaches 
zero. This, in turn, will harden the integral constraints on the whole fre- 
quency responses of cf(S) and <r(T), as can be seen from the Poisson inte- 
gral inequalities obtained by Chen (1995), e.g., 

- [ log g(S(jcu)) 2 T 7 ^ T 2 dcw - log a(S(q)) . (4.34) 

7t J-oo CTq + lOJq— U)J 

Summarizing, the analysis in this section has shown that unstable mul- 
tivariable near cancelations lead to poor sensitivity properties. On the one 
hand, ORHP zeros and poles of the open-loop system having the same 
directions and near frequencies cause the elements of the sensitivity func- 
tions to exhibit large peaks, as demonstrated by (4.33). On the other hand, 
ORHP zeros and poles of the open-loop system at the same frequency and 
having directions close in norm produce peaks on the maximum singular 
value of the sensitivity functions, as seen from (4.34) and the above discus- 
sion. This suggests that multivariable approximate cancelations of ORHP 
zeros and poles should be avoided if possible. 



4.3.6 Examples 

In this subsection, we give examples that illustrate the issues discussed 
before for continuous-time multivariable systems. 

Example 4.3.1. Consider the plant 



G(s) 



1 s s + 3 -I 

(s + 1) 2 (s + 1)(s + 2) 

1 — s s + 4 

.(s + 1 ) (s +2) (s + 2) 2 . 



(4.35) 



which has an ORHP zero at s = 1 with output direction equal to = 
[5, —6]. Since this direction is not canonical, we can argue from §4.3.4 that 
there will be a cost in sensitivity associated with achieving diagonal de- 
coupling. We will investigate this cost. 

Direct application of Corollary 4.3.2 leads to the following inequalities 
that must be satisfied by the entries of the sensitivity function, regardless 
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of the design methodology used: 

1J°° log js n (jtu) - | S 21 (jcu)j dcu > 0 , (4.36) 

-[ log|^Si 2 (icu)-S 2 2 (icu)| 1 2 do) > 0 . (4.37) 

7t J ^ 1 6 | 1 + cn z 

Assuming further that the sensitivity elements are required to satisfy (4.29), 
then Corollary 4.3.4 gives the following lower bounds on linear combina- 
tions of element norms: 



Oq ( U. 



IlSnlU + f ||S 2 i||oc> (— - 
5 \ a ii ‘ 


1 ^Tr-Oqlaj,) 

F 6/5 a 2 i J 

0q (a>i ) 

1 ^7t-0q(cUl) 


(4.38) 


HS22H00 + 1 11S12H00 > — 

6 V a 22 - 


F5/6 an/ 


(4.39) 



Next, we add the restriction of diagonal decoupling. Then, using (4.31) 
and (4.32), we have, for k = 1 , 2, 

| log|S kk (jcu)| 1 + ^ 2 dcu > 0 , (4.40) 

e q ( CO 1 ) 

||S kk |U> f . (4.41) 

\<* kk / 

Comparing (4.36) and (4.37) with (4.40), for k = 1 and k = 2, respectively, 
it is clear that the constraint on the diagonal elements is alleviated if the 
off-diagonal entries are nonzero. More interesting, however, is to compare 
the lower bounds on the peak sensitivity given by (4.38) and (4.39) with 
(4.41) for k = 1 and k = 2, respectively. Consider, for example, (4.38) and 
(4.41) for k = 1 . These bounds are shown in Figure 4.2 as a function of the 
reduction level oci i , for cm = 0.3 and for different values of a 2 i . Observe 
that ot 21 = 0 in (4.38) (curve 1 in Figure 4.2) corresponds to the lower 
bound in (4.41) for k = 1 . Comparing curve 1 with the other curves in 
Figure 4.2, we can see that relaxing the requirement of diagonal decou- 
pling and allowing the level of sensitivity reduction in the off-diagonal 
elements (S 21 in this case) to be greater than zero, significantly reduces 
the constraint on the combination of peak sensitivity values. 

To further analyze the cost of decoupling, we next apply the particu- 
lar design methodology proposed in Weller and Goodwin (1993). This 
design technique allows one to achieve different degrees of decoupling 
while keeping other design parameters essentially constant. Following 
this method with the parameter a n — which very roughly defines the 
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FIGURE 4.2. RHS of (4.38) as a function of cti i , for tui = 0.3 and for: 1- ct 2 i = 0; 
2 -oc 2 i =0.01; 3- a 2 i = 0.05; 4- a 21 =0.1. 



bandwidth — equal to 1 , the resultant closed-loop sensitivity is 



S(s) 



s 3 + s 2 (2 + A) + s(1 + 3A) 

(7+Tp 

(A — 1 ) (3s 4 — 1 6s 3 —21s 2 ) s 3 + 3s 2 + 4s 
3(s + 1 ) 5 (s + 1)3 



(4.42) 



where A = 1 gives diagonal decoupling and A < 1 gives partial and static 
decoupling. 10 

Because of the structure of this particular design, which leads to S 1 2 = 0, 
the integral constraints that must be satisfied are, for A < 1 : (4.40) for 
k = 1,2, and for A = 0: (4.36) and (4.40) for k = 2. Comparing (4.36) and 
(4.40) for k = 1 indicates that there should be an increase in the sensitivity 
peak of Si 1 if diagonalization is required. This is evident from Figure 4.3, 
where |Si 1 ()cu)| is plotted for different values of A in the range 0 < A < 1 . 

Turning to the singular value approach, note that the integral constraint 
(4.34) holds due to the presence of the ORHP open-loop zero q = 1 , i.e., 

logCT(S(ju>)')y-j ^2 dm > logCT(S(1]) . 



The above constraint, as it is stated, depends on the particular design 
methodology. However, it is easy to show that ct(S( 1)) > 1 for any de- 
sign, 11 and hence the weighted integral of the logarithm of the maximum 



10 The closed loop of Figure 4.1 is said to be: statically decoupled if it is internally stable 
and the complementary sensitivity function T is nonsingular and satisfies T (0) = I; partially 
decoupled if it is internally stable and the complementary sensitivity function is nonsingular 
and lower triangular. 

11 This is because of norm properties and the fact that, if the open-loop system has an 
ORHP zero q, then there exists a vector V such that 4'*S(q) = IF*, see Theorem 13.1.1 in 
Chapter 13 for more details. 
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FIGURE 4.3. Effect of decoupling on Si i (jtu) for Example 4.3.1. 



singular value of S is nonnegative. This implies, for example, that, for 
any design, the frequency response of cf(S) will necessarily achieve val- 
ues greater than one. 

We next consider again the (partial) decoupling design of Weller and 
Goodwin (1993), which led to the sensitivity function given in (4.42). Fig- 
ure 4.4 shows the maximum (left) and minimum (right) singular values of 
S for different values of A in the range 0 < A < 1 . 





FIGURE 4.4. Maximum (left) and minimum (right) singular values of S in Exam- 
ple 4.3.1, for different degrees of decoupling. 



In particular, the plot on the left confirms our prediction that a(S(juj)) 
would peak above one. An interesting observation is that total (diagonal) 
decoupling (A = 1) is the best situation for the maximum singular value, 
in the sense that A = 1 gives the smallest peak value for its frequency 
response. This situation is desirable since, as seen in §2.2.4 of Chapter 2, 
having a(S(jco)) small is a requirement for robust performance against 
e.g., unstructured divisive perturbations of the plant. On the other hand, 
decreasing A from 1 to 0, i.e., relaxing the degree of decoupling, increases 
the peak value of the maximum singular value. Comparing these conclu- 
sions with the previous ones about the hardening of the constraints on 
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the element Sn as the degree of decoupling is increased, we can argue 
that, for this particular design methodology, the greater the degree of de- 
coupling achieved, the worse the disturbance rejection properties of the 
diagonal elements become, while the performance is made more robust 
against unstructured perturbations of the plant. 

Example 4.3.2. Consider the plant 

(1 — s)(s + 2) 

(2s + 1)(s + l)(s + 3) 

— (s + 2)(s 3 +4s 2 + 3s + 4) 

(2s + 1 ) 2 (s + 1 )(s + 3)(s + 5) 

(4.43) 

which has an ORHP zero at s = 1 with output direction equal to ¥* = 
[1,0]. This plant was considered in Weller and Goodwin (1993), where it 
was shown that the corresponding interactor matrix is nondiagonal and 
hence diagonal decoupling was achieved at the expense of introducing 
additional nonminimum phase zeros and increasing the relative degree of 
the closed-loop transfer functions. 

From the point of view of sensitivity constraints, however, no increase 
in the peak value of |Si i (jcu)| is expected due to diagonal decoupling since 
the zero direction is canonical. Indeed, as discussed in §4.3.2, the element 
Si i satisfies the integral constraint 

| log |Si i (jto)| - den > 0 , 

whether or not the system is decoupled. Thus, in terms of the sensitivity 
bounds presented in this chapter, there is no apparent cost associated with 
decoupling. 

Using the methodology of Weller and Goodwin (1993), leads to the fol- 
lowing sensitivity function: 

4s 4 + s 3 (14 - 2A) + 14s 2 + s(4 + 2A) 

(s + 1) 3 

(1 — A)s 4s 3 + 8s 2 + 6s 

(2s + l) 2 (2s + 1 ) 2 (s + 1 ) 

where, as before, A = 1 gives diagonal decoupling and A < 1 gives partial 
and static decoupling. Figure 4.5 shows the plot of |Sn (jco)| versus fre- 
quency, for different values of A in the range 0 < A < 1 . It can be observed 
that the change in the peak of Si i for different values of A is minimal and, 
in any case, is accompanied by a change in bandwidth. Comparing the 
results with those of Example 4.3.1 we conclude that here we essentially 
have only a frequency trade-off in sensitivity, whereas in Example 4.3.1 
we also had a spatial trade-off; yet both have a nonminimum phase zero 




(1 — s)(s + 2) 

(2s + 1)(s + 1)(s+4) 
-(s 4 + 7s 3 + 14s 2 + 6s - 4) 
(2s + 1) 2 (s + 1)(s + 3)(s+4) 
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FIGURE 4.5. Effect of decoupling on Si i (jtu) for Example 4.3.2. 



at the same location. The difference in these examples can be traced back 
to the directions associated with the zero. 



Example 4.3.3. Here we study the importance of directions when evaluat- 
ing the impact of near cancelation of ORHP zeros and poles. Consider the 
plant G = Dg'Nc = NgD/. 1 , where 



Dg(s) 

Ng(s) 



; — 1 
; + 1 

1 



= D G (s) 



The matrix Dq has a zero at s = 1 with input direction [2/3, —1]*, which 
corresponds to an unstable pole of the plant. 

We will use the parametrization of all stabilizing controllers for the 
given plant. This parametrization possesses a free parameter, which will 
be used to study the effect of directions in near pole-zero cancelations. A 
straightforward calculation shows that the matrices 



X(s)=Y(s) = 



s + 1 

(s + 2) 2 s + 2 
(s + 1 )(s + 3) s + 3. 



satisfy XD + YN = I. Following Vidyasagar (1985, Theorem 5.2.1), we 
have that all controllers that stabilize the closed loop have the form K = 
(X + RNg) -1 (Y — RDq), where R is a proper and stable transfer matrix 
such that X + RN g is nonsingular and biproper. We next choose R to have 
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the following special form 



>1 ($.) 


T3(S)' 


s + 1 


S + 1 


T2(s) 


r 4 (s) 


.S + 1 


s + 1. 



where the polynomials r if i = 1 , . . . , 4, have degree one and are such that 
the matrix R satisfies the following interpolation constraints 





and R(l) = 


r 0 27 ^ i 

2(6i|>2 + 9ih) 

0 9 81rh 






L 8 4(6rp 2 + 9r)>i ) J 



It is possible to verify that this choice of R has the following properties: 

• The controller stabilizes the closed loop. 

• The closed loop achieves static decoupling. 

• The controller has a nonminimum phase zero at s = 1 with input 
direction ¥ = [rpi,rp 2 ]*- 

Thus, we can freely specify the direction of the zero of the controller, which 
is at the same frequency location as a pole of the plant. 

First note that, as discussed in §4.3.5, internal stability will be lost if ¥ 
is aligned with [2/3, —1]*. To continue, we will use ¥ to show that the sen- 
sitivity does not necessarily behave badly for coincident ORHP poles and 
zeros unless their directions are also (nearly) collinear. To do this, we con- 
sider several choices of ¥, starting with ¥ = [— 1 .94, 3.04] * , which is almost 
collinear with the direction of the pole, and then rotating ¥ clockwise up 
to ¥ = [3, 2]*, which is orthogonal to the plant pole direction. 

Figure 4.6 shows the peak values of |Ttj (jcu)|, i, j = 1 , 2 (in dB), as a func- 
tion of the angle between zero and pole directions, which ranges from 
— 0.997T (almost collinear) to -7t/2 (orthogonal). It can be seen from this 
figure that the peaks increase significantly when the direction of the con- 
troller zero gets close to the corresponding direction of the unstable pole 
of the plant. Note, however, that the peak values are not large when the 
direction of the zero is not close to that of the pole. These results are in 
accord with the conclusions drawn in §4.3.5 and emphasize the role of di- 
rections in quantifying performance limits. o 



4.4 Discrete Systems 

In this section, we briefly address discrete-time systems. In particular, we 
give the discrete-time counterpart of the Poisson sensitivity integral for 
multivariable systems developed for continuous-time systems in §4.3.2. 
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FIGURE 4.6. Peaks in complementary sensitivity versus angle between zero and 
pole directions. 



4.4.1 Poisson Integral for S 

Consider the unity feedback configuration of Figure 4.7, where the open- 
loop system, L, is an n x n, proper transfer matrix of the complex variable 
z. As before, assume that L is formed by the cascade of plant, G, and con- 
troller, K, i.e., L = GK. Let the plant and controller have coprime factoriza- 
tions 12 as in (4.2). Then, the sensitivity function in (3.43) can be expressed 
as in (4.3). 



L(z) 



FIGURE 4.7. Discrete-time feedback control system. 

To preclude unstable pole-zero cancelations in the open-loop system, 
we make the following assumption. 

Assumption 4.4. The sets of frequency locations of zeros and poles of the 
open-loop system L outside the unit disk are disjoint. o 

Under Assumption 4.4, if q e is a zero of N g (i.e., a nonminimum 
phase zero of G) with output direction ¥ e C n , then S and T satisfy the 
following interpolation constraint 

¥*S(q)=W*, and ¥*T(q)=0. (4.44) 

Other interpolation constraints hold at the plant's unstable poles as well 
as at zeros and poles of the controller in ID (see Lemma 4.1.1). 





2 Over the ring of proper transfer matrices having poles inside the unit disk (i.e., stable). 
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Assume that S is proper and stable, and consider the notation of §4.3.1. 
In particular, p k in (4.24) is now a proper, stable, scalar rational function 
of z. Let B k be the Blaschke product of the zeros of p k in B , defined as 



B k (z) = 



n Zi_ Z-Zj 

l=1 |ztl 1 -Ziz 



Then, p k can be factored as 

p k (z) = B k (z) p k (z) z , (4.45) 



where 6 k is the relative degree of p k , and p k is stable, minimum phase, 
and has relative degree zero. Note that, for the common situation of a 
strictly proper plant, the diagonal elements of S are biproper, and hence 
6 k in (4.45) is zero in this case. 

We then have the following result. 

Theorem 4.4.1 (Poisson Integral for S). Let q = r q e j0q , r q > 1, be a zero 
of the plant G, and let W g C n , W fO, be its output direction. Assume that 
the sensitivity function, S, is proper and stable. Then, for each index k in 
Ow, 



27T 



\_J°Z I_ 




j " 1 

1 — 2r q cos(0 - 0 q ) + r^ 



d0-log B,'(q) + 

6k log |q| , 

(4.46) 



where B k and 6 k are as in (4.45). 



Proof. Note that log |p k |, with p k defined in (4.45), satisfies the assump- 
tions of Corollary A.6.4 in Appendix A. The result then follows by using 
this corollary on log |p k | as in the proof of Theorem 3.4.2 in Chapter 3, and 
then using the interpolation constraint (4.44) in a similar fashion to the 
proof of Theorem 4.3.1. 0 

The following corollary establishes a constraint that is independent of 
the controller. 



Corollary 4.4.2. Under the conditions of Theorem 4.4.1, the sensitivity 
function S satisfies, for each index k in Lh, 



27T 




^S ik (e j 



Tq — 1 

1 — 2r q cos(0 — 0q) + Tq 



d0 > 0 . 



(4.47) 



Proof. The proof follows from (4.46), on noting that |B k 1 (q)| > 1 and 
6 k log |q| > 0. D 



The above results will be used in the following chapter to study limita- 
tions for periodic systems. 
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4.5 Summary 

This chapter has discussed two different approaches to the investigation 
of sensitivity limitations in multivariable linear control. One of these ap- 
proaches uses integral constraints on sensitivity vectors, whilst the other 
approach considers integral constraints on the logarithm of the singular 
values of the sensitivity functions. Each of these approaches to the prob- 
lem emphasizes different aspects of multivariable feedback design, and, in 
combination, they provide a general view of multivariable design limita- 
tions imposed by open-loop ORHP zeros and poles. On the one hand, the 
analysis by means of integral constraints on sensitivity vectors has proven 
particularly useful to give insights into multivariable issues especially re- 
lating to the cost of decoupling, spatial and frequency domain trade-offs in 
sensitivity reduction, and the effect of directionality on the impact of near 
unstable pole-zero cancelations on performance. On the other hand, the 
integral relations on the logarithm of the singular values of the sensitivity 
function suggest a link between the directionality properties — in terms 
of singular vectors, see Chapter 2 — and sensitivity reduction. Indeed, all 
these integral relations exhibit a term involving the Laplacian of the loga- 
rithm of sensitivity, which, in turn, using a technique due to Freudenberg 
and Looze (1987, p. 184), can be expressed in a way that highlights the 
directionality properties of the sensitivity function. The understanding of 
the role of these Laplacians and their implications toward feedback design 
probably merits further investigation. 



Notes and References 

Bode Integral Formulae 

§4.1 and §4.2 are largely based on Chen (1995). This work also obtained Poisson 
integral constraints on the singular values of the sensitivity function. 



Poisson Integral Formulae 

§4.3 is based on Gomez and Goodwin (1995). This latter work also presented de- 
sign limitations for distributed systems, which allows one to consider transfer ma- 
trices with different time delays affecting each entry. The extension to this class of 
systems required additional technical results regarding zeros and the behavior at 
infinity of entire functions. The examples in §4.3.6 were also taken from Gomez 
and Goodwin (1995). 

Other results on design limitations for multivariable systems were given by 
Boyd and Desoer (1985). This work obtained inequality versions of the Bode and 
Poisson integral formulae based on the recognition that the logarithm of the largest 
singular value of an analytic transfer function is a subharmonic function. 
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Related work has been reported by Freudenberg and Looze who convert the 
multivariable problem into a scalar one by pre and post multiplying the sensitivity 
function by vectors (Freudenberg and Looze, 1985) or by the use of determinants 
(Freudenberg and Looze, 1987). Similar ideas appear in the work of Sule and 
Athani (1991), who use directions associated with poles and zeros of the system, 
resulting in a directional study of trade-offs. 

§4.4 follows Gomez and Goodwin (1995). Alternative approaches to the prob- 
lem of integral constraints for MIMO discrete systems can be found in Chen and 
Nett (1995), and Hara and Sung (1989). 




5 

Extensions to Periodic Systems 



Periodic dynamical systems frequently arise in applications. Examples 
include batch processes that are taken through a periodic operating cy- 
cle, and systems where periodic or multirate sampling strategies are em- 
ployed (Feuer and Goodwin, 1996). A periodic system is time-varying in 
nature; however, by using time or frequency domain raising techniques, 
it is possible to reduce the analysis to that of a special LTI multivariable 
system. 

Here we focus on discrete-time linear periodic feedback systems. For 
these systems, the integral constraints for MIMO discrete-time systems of 
§4.4 in Chapter 4, can be used to quantify sensitivity limitations. However, 
the implications of the latter results in the present context are different and 
reflect the intrinsic structure of periodic systems. 



5.1 Periodic Discrete-Time Systems 

Consider a state space description for an n-input n-output discrete-time 
periodic system given by 



Xk+i = A k x k + B k u k , 
U k = C k x k + D k u k , 



where {A k }, {B k }, {C k } and {D k } are periodic sequences of period N. With 
each of these periodic sequences, {A k } for example, we associate its Fourier 




